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ABSTRACT I - 

The Elementfiry and Secondary (ESEA) Title I project 
components for Hawaii's Maui District are evaluated in this document. 
The first section reviews the ''following: the reading resource rooms, 
the preschools, and the measurement of academic gain as shown by the 
Peabody Individual Achievement Test. The second section presents a 
school-by -school examination o£^ ^ach project, as well as data tables 
relating to individual projects.- ^t also presents the pre- and 
post-test results of the Peabodj. The third sectiofi provides the'^ 
assessment of various components of the Maui District ESEA Title I 
projects in alphabetical order of the schools/projects. Each project 
component is evaluated on the basis of the given original and revised 
project objectives. Recommenda|,ions are made which focus on, the 
following afeas: pupil eligibility, selection, and identity; 
standardizing achievement measuring instruments; .leisure and 
enrichment readings; teacher effectiveness; motivation and learning - 
theory; peer tutoring; preschool; and parent involvement. It is 
concluded that projects during thf 1973-74 academic year are more 
organized, more effectii^e, and of more help to the pupils than they 
were during the 1972-73 academic year. (Author/AM) 
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PREFACE 



Evaluation of th^ Elementary and Secondary Education Act (ESEA) title. I 
programs of Maui District, 1973-74, was provided by the Soci^ Welfare 
Development & ^Lesearch Center (SWDRC), of the University of Hawaii, Hanoa 
Campus. This^report was prepared ahd submitted -In accordance w^h the / 
Memorandum of Agreement between the State of Hawaii Department of Educati.on 
and the S^DRC. . A progress report of Title I programs, preseipited at mid-year, 
preceded this final Evaluation of Project .Components . / ' . 



The Soci^l^ Welfare Development & Research Center is a University pf Hawaii 
public sferyice organiziation. While its work focuses upon delinquency 



, an^ ev^xuacxpn^ une | 



prevention, program consultation, personnel training, anq evjiluatipn; the 
^ Center also Introduces new approaches and techniques to a variety of human 



service agencies in this State. Its primary objective is>to help cotmnunity, 
organizations, public and private, to establish the most effective and ^ 
alternative ways to prevent and treat the socially maladaptive behaviors oi 
Hawaii's youth. A fundamental goal of the Center' ej" operations is to obtaiil 
and disseminate j^ew knowledge of potential relevance to public ^ppncies 
concerned with .the progressive educational development of c|fildren» In 
addition to training and prograA consultation, evaluation and research are 

\ ■ " 

" essential elements of the CenterXs operating model. Program evaluations are 
conducted for the purpose of seeking improvements to current effort^ and to 

propose.. alternative splutions for greater efficiency. Researcji efforts are 

.r ■ ■ , ■ 

aimed at assessing the many varia'bles contributing to the effectiveness of 
approacherf^and to seek modifications to current approaches. based upon 
. analysis of o^ijective data. ^ . 
^ This final evaluation report for 1973-74 is designed around a develop- 

ment^al approach. To fully ilnderstand an^ segment of this^Wlbort reauiTes that 

■ ■ ^ ■ ^ 
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. .the entire evaluation be read ftom beginning to end > with no one portion being 
•independent of any others. The. narrative, analysis of data, and statistical 
Interpretations are piresented in an orderly,^ unatnbl^guous, and straightforward 
manner.. No prior knpwledge'of statistical measurements, tests, or project 
components is necessary for the reader to understand this report. Following . 
the explanation of"^ data and a schobl-by-school examination of each program 

- - '1. . - 

. ^. 4re some' general recommendations concerning future program development, A 
careful reading of the complete report, however, is essential before the 
significance of the recommendations and general conclusioos can be realized. 

The purpose of this report is not to make a blanket Judgment - either / ' 
good or bad - of any program, but to ascertain what causal .relationships may * 

' ^ > , • y 

exist between the pupils' educational siiccess and their classroom environment, 
Whffe the report presents an appraisal of data from throughout Maui District, 
the Intent was nbt to compare and contrast one program with another . Such 

•0 comparative analysis would be both impractical and unwarranted, far ^each^ - - 
program functioned withi^^ its unique geographical area- and served its own 
specially selected pupils. The objective is not to uncover the projects' 
past mistakes, but to help Title I educators gain from the lessons of hind- 
sight, an ability to fbresee new approaches and apply these with a broader 

, understanding. . - ^ 

l Not unlike pre- and post-testing, this report is presented to indicate 
the progress whi,ch has already been achieved, as ^well as the potential for ^ 
furoret^eVelopment which liek ah : Evaluation of Project Components was 
written to identify the . extent^ of educational achievement which occurred and 
to specify what influences upon the children encouraged the learning behavior, 
-to artse. ^s this knowledge develops, more effective and beneficial approaches 

' » ' ■ 

to education become possible* 
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It is apparent that the personnel of Maui school district have made a 

dedicfited effort to ajjvance the deveiopment^nd quality of educational services ^ 

offered iitle i children. The sincerity of these professional educators, 

•'Si ■ ■ ' \ ^ ' 

th^ir concern. for the basic educational needs of pupils*, arid their willingness 

' ■' • 

to work With new and innovative approaches for the benefit of the children / 
they serve ire all commendable. The personal integrity and concern for 



program development which the Maul^rf^trict personnel have shovm are reflectitd ^ 

in the fact tb^ a .third party evaluation of Title I projects was requested. 

' ■ 4* • ^ »^ ' • 

,This is a sound and justified decision which indicates .objective insight and 

• • - ' ■' •'v^ , ^ ' ' . , • 

consideration for future program implementation. Research has shown that 
self-evaluation by program/implementors soon results in subjective and 
laudatory appraisal that^as little basis in fact and no significant effect 
toward further program innovation. - 
We were very impressed throughout this past academic year with the 

a . ■ ■ , 

evident dedication, motivation, and sincerity shovm by Title I personnel in 
the eleven ESEA Title I schools of Maui District. Cooperation and active 
support of evaluation procedures fcere offered to the SWDRC ^from each school's 
Title I personnel. ' 1 ^ ^ v 

This report was initially drafted by David C. Swanson, SWDRC Evaluation 
Specialist, under the supervision and direction of Robert T. Omura, Assistant 
Director and principal program consultant to the schools. Selected members 
of the Siy)RC staff also assis'fced with data analysis anS participated in the"^ 
formulation of recoomiendations. 



Jack T. Nagoshi, Director 

Social Welfare Development & Research Cente 
University of Hawaii^ Manoa Campus 



TABLE OF CONTENTS - - . ^ ^ 

> ' : ' ^ Page 
PREFACE \ ....... ' i . 



PVALUATION 1 

SWDRC ACTIVITIES , ; 4 

ESEA TITLE I PROJECT COMPONENTS ^ . '-.< * 7 

y R^dliig Resource Rooms • . . 7 

FrescHools 8 

Measurement of Academic Gain: "^ral . . .'^ . 11, 



DATA PRESENTATION!^ & EXPLANATICM^ OF TABLES . . . . . . 15 

Pre- and Post-Test Results of PIAT . . f 17; 

Average Monthly Gains 21 

Rank Order of Gains by Projects & Grade Levels a • 25 

A'jerage Gain During Intervention . 27 

Achievement, of Criterion 30 

Estimates for Improvement In Behavior . . i 32 

Piipll 4ttendance Record . 1 . 35 

Leisure & Enrichment Reading J . . . 37 

Preschools: Test of Expressive Language 39 

Preschools: Checklist of Basic Skills 40 



ASSESSMENT OF PROGRAM . . . K. . . . . . 43. 

Objectives i . 43 

Haiku School ....... ^ ........... 44 

Hs^na High & Elementary Schools 47 

Kaunakakal Elementary School ........ /N. 49^ 

Klhel School ^^-z' ' ' 

Kllohana Elementary School . 55 

Kula School • • • • 

Lanal^Hlgh & Elementary Schools. ^ 64 

Pala School 66 

Puunene School 69 

Walhee School 71 

Walluku Elementary School .... 74 

CONCLUSION & RECOMMENDATIONS .... . 78 

Pupil Eligibility, Selection & Identity . 79 

Standardizing Achievement Measuring Instruments . • • ' 81 

Leisure & Enrichment Reading ..).... \ 83 

Teacher Effectiveness: Experleace & Traltilng . 84 

' Motivation & Learning Theory 85> 

Peer Tutoring: ' A Teaching Strategy ...... ; 87 

Preschool Focus 88 • 

Parent Involvement . • . .|. . . 89 

Outcomes of Previous Recommendations • . 90 

. , ' • ■ / ' ' ^ ^ 

Q /^PENDIX - * ' - ^ V - 6 

ERIC ^ ' ' 



EVALUATION 



As ESEA Title I programs; ^re funded by the federal government, these 
programa. are required to meet the*crlterion of ev^uation, .The connotation" 
behind the word "evaluation" often - but erron^eously - suggests to the teacher 
A threatening or awkward situation, that of being told ;^how and how* riot to 
teach. This uncomfortable situation whiqh the teacher experiences is 
compounded by^the social expectation that the teacher already know^, or should 
know, all there is to. know about ' teacl^g. Although such an^tiety oj/the 
teacher's part is not jusitified by fact, the^response is often -Uflut do we 
really have to prove everything with facts and figures?" The answer, 
certainly, is no. It is self-evident that a classroom with appropriate 
teaching. devices and .sufficient instructional materials is better than one 
without aixy. It is self-evident that an org^zed classroom where every 
learner, is actively^^^d in meaning fu^;^i^^ty is fetter than a noisy and 
disorganized one. Yet the direction and progressive success of pupils and 
^classroom activities, in most cases,- must be revealed through facts which are 
not so clearly self-evident. "^^^ 

Evaluation is not an analytical process or- technical procedure of proving 
anything. It is not abstract, impersonal, or automatic, for such a process 
would constitute a mere academic exercise. There is no secret or mathematical 
formula which. If plugged into a classroom, could produce irrefutable proof 
that the children were truly learning. • ^ i ~ 

Evaluation consists of assessing the needs of students and teacher,' 
observing classroom activities, recommending alternatives, and carefully 
examining what actually takes place. The purpose of evaluation is not to 
prove, but3^:o improve. The evaluation procedure requires measurement of 
academic gains and those characteristics frequently ^sociated with academic 



gains. Through accurate measurement the observations and assessments become 
more. significant and the recommendations more viable. Statistical data 
gathered for evaluation isn^tused as proof, but as a reliable indicator of 
the extent and direction of program success^ Such measurement is used. to 
suggest more effective approaches to. greater program j^mplementation. VThen 
achievement occurs in the classroom it can be measured and associated with the 

■ • ■ ■ ■ ' ■ . ■ ■ ., . . ) 

classroom environment which influenced pupil behavior and produced achievevient • 
From^ an analysis:[^{r£vjt^e success rate and the tlassroom environment, evaluation « 
is dbleoto of£er reasonable recommendations: listening posts are dore < 

f'- ■ ■ ■ ■■ ' 

effective when teacher attention needs to be dispersjed; motivated pupils 

tend to work longer and harder than unmotivated ones; children achieve more 

wh^n their parents encourage them. 

. To detepnine relijahle data it must be empirical, objective, quantrtative, ^ 

ana;^behavioral. To measure a learned behavior it must first be observabl^^ 

andjsecondly, cqunted. Evaluation must not be based upon ^'opinion, bias, or 

. ' • ■ ■ ■ /--^ ■ „ 

subjectivity, for the recommendations ^r;Lsing from them ^ould be of very limited 

. • <- '■ t ' 

value. Data must be' systematically gathered, carefully examined, and inter- 

\ ■ -4 . 

preted in light of the yearns ongoing activity within jeach classroom. From 

this research arises the basis of evaluation, and through evaluation new 

knowledge is gained. With this increased understanding nevT^echniqucTs and 

approaches are recommended, alternative procedures ^nd materials are suggested, 

and innovative methodology is i^roduced. To examine various aspects of new, 

information gained through recent educational^researt:h, it is suggested that 

the SWDRC 1972-73 Evaluation ^o^ Project Components be reviewed. Special 

attention should be'^given to the lBl:rodu|tdon (pp. 1 - 7), An Empirical 

Ins tn>ctioiid^. Model for t^l^^^^^epedial Education Process (pp* 8 13), Parental... 

Involvement (]pp. 87 ~ 92), and Introduction to Remedial Language Arts/Reading 

(pp. 30 - 33). . ' Q • r ^ ' 



\ 



Evaluation assessments are made by determining a) how effective the, ^ 



program Is, bj which variables contributed in what degree to ^ the effectiveness 
of the progz'am, and^c) what mbdificat^i«ns in approaches and techniques would 
be likely to increase ef feqtivepess. Edch of^these questions mu^t be ans^red 
for evaluation to be complete. As the solutioil to these questions are found, 



greater understanding of the problems and programs designed to alleviate t.hem 
will b$ known. ^ . „ 



... SWDRC ACTIVITIES . . • 

|, — ~~ ' ■ ^ ^ • : ■ ■ 

* ^ ^ > ^ ' \ ' • , 

The Social Welfare Development 6e Research Center' initiated evaluation j-v 
; ' ■ >■ ■ >^ ■ 

slfervices to. the eleven Maui District ESEA Title I projects at the beginning. 

of ^the 1973-74 academic year. In addition to a covjBt letter introducing the 
SWDRC to project teachers, each program received a set. of specially designed 
assessment forms for the recording of data. Information requested by tshe 
SWDRC included data from two preschool tests, ^stim ^es of pupil T^ehavior, the 
ni^l^r of books read by pupils, attendance rates, and scores, from all five 
subtests pt the Peabody Individual Achievement Test,. Similar assessment forms 
were again issued to each project in April for the recoriding^of post-data, 
with the changi^' scores serving as the fundamental basis for statistical 
evaluation. This standardized procedure of requesting the same information 
(at the sam^Xime and on identical assessment forms) from similar projects 
provided a systematic ^d precise measurement of program objectives. 

During the first two months of the academic year a number of objectives 
were revised. This was- done by the District Office, school principals, and 
project teachers, in consultation with the SWDRC, This revision provided 
greater clarity, understanding, and accuracy in measuring program achievement. 
The alterations made in program objectives reduced the subjectivity and 
ambiguity which was present, replacing this with more behavioral and quanti- 
tative specifications. \ ^ 

From September, 1973, through May,^ 1974, the SWDRC visited each plpiect " 
at least four times for all scWoLs e-xqj^t Hartal and Lanai, vith mor^^ nuwerousV 
visits made to- those programs which required further assistance. While all 
projects were observed ,and offered consultfStion from the SWDRC, priority. was 
given to those teachers (jP^eque^ted add;fcti<nnal help. In all cases, ideas 
for improvement, greater effectiveness, and innovation were offered. Data 

iO 



were collected and examined for accuracy, observations were care'fully made, 
and all questions were answered. 

The Center's activities included observing each classroom' s arrangement 
and activities, instructional materials aid machines, the techniques uffi^d, 
and testing procedures. Discussions with educational assistants, project 
teachers, arid principals* focused on the behavioralj objectives, Title I guide- 

* A 

lines, selection of pupils, and program development. Special attention was 

given to. immediate problems arising within the classroom and to the channels 

of communication existing within -the school. - In cooperation with the Maui 

District Office group meetings of the Title I teachers on Maui were arranged 

and conducted for better dissemination of information between projects. 

Throughout tlie academic year the SWDRC offered individual recommendations and 

suggestions for improvement to each project. 

In an attempt to assess the impact of the ESEA Title I projects within 

the respective schools and to further ascertain the degree of parental 

involvement, a number of questionnaires were Sbrepared apd distributed, 

Specific surveys among principals were taken once during the fall - relating 

to general information jjijjout the school, its program for children with spec4.al 

needs ahd information about parental Involvement /and cotmnunication, A second 

survey requesting other information was made during the spring* A questionnaire 

/ ■ . ' ' I ■ 

especially designed far parents identified with the scli^ol through the 

, * r . ' * - . . ■ * 

parents and teachers association (PT|^),' the Title I Parent Advisory Council 
(PAC) and other related organizations, was mailed out at the mid-year point. 
^' * Questioris relating to parent-teacher and teacher-teacher communications 
were prepared in two specific questionnaires sent to the project teachers 
•and referring regular classroom teachers of the .resp'ec£ive schools. 



t. Although thJ resijlts of* the surl^ys. Were ^nexally' subjective in* nature - 
and not tooj reliabM fo^ objective e^^6iua|:tons,*^ the teaponses did present 
interesting sidelights tp the effect of, Tit l6;0[ .programs. \^ the schools. 

The observations aiyd retpnimen^dati^ order thieit more ^ 

^effective programs would, emerge in" ^he^^a^ng^^ lo^^^* 
range development of efficient apd ef fectiy^vemedial pragrams\Was the aim 
of the evaluation services provided to- these Maul, District Title I programs. 



ESEA TITLE I. PROJECT CCMPQNEWrS . / 



REAPING RESOURCE ROOMS ^ • 

' '. ^ \ . ' 

^ / , ' ^ ' ' ' \/ / . " 

^ Maul District supported eight ESEA Title I' Reading* Resource Rooms during 

the 1973*74 academic year. While six of tfiese projects were in central Mauil 



and two on.Molokal, their gpttls were similar: to effectively instruct under- 
achieving pupils In the areas of language arts and reading improvement. 
Reading recognition and reading comprehension, and listening and oral skills 
were_ emphasized. ' . ' 

With pupilTs selected^ f3r the programs' first by their low test scores on 
standardized reading tests and secondly by teacher referral, each project 
was designed to offer pupils supplemental help which they could not receive 
from their regularly scheduled classes. SpecTtal instructional materials 
and devices were available in most classrooms. Only one project titilized 
the services of an educational assistant. All projects, to Varying degrees, 
developed an organized' and generally efficient use of classroom space. ^ 
Motivational techniques, such as positive reinforcement - tangible and 
social - and free time activities^ were used in the classroom management 
of all projects. In a few cases, however, this approach was only touched 
upon, while ift^'iother classrooms the motivating factor, was^ Well ^veloped 
and integral part of the pupils' daily activities. 

The goals of" all reading resource rooms were generally similar. The 

primary objective was that the pupils would show a learning rate greater 

... * 

than .1 per month in reading recognition and reading comprehension. Other 
objectives involved the pupils' attendance rates, behaviors, and the number 
of books- which they read. These objectives were met, at differing levels^ 
by most projects. 

13 
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The greatest advantage to the pupils ofvreadlug resource rooms is that jt- 

*' * 

• each classroom was relatively self-contained, with its own speciaL materials, 
machines, techniques, innovative approaches, and teachetr.. This aw^angement ► 

• encouraged >a more specific classroom organization, close supervision, direct^ 
teacher-to-pupil contact on a daily l}&sis, and, most, importantly, provided 
the time and opportunity for individualized instruction to occur • Through 
these reading resource rooms it was possible t;o provide* each child with 
individual diagnosis, prescription., instruction, and evaluation on a daily 

or weekly basis. " . 

Identified and selected pupils** reported for specific: amounts of time 
each day and received remedial instruction in the basic skills of reading. 
Depending on the number of personnel within the Reading ^Resource Room, i.e.,- 
project teacher plus an educational assistant (in one project), the average 
attendance per instructional period ranged from four to ten pupils at a time, 

Kilohana School (Molokai), in addition td Remedial reading services,- ^ 
provided counseling and guidance services through a full time project counselor- 
Individual guidance services were extended to identified pupils of the school 
who were eligible for ESEA Title I participation. . ' 

. ■■ ' - ^ : ■ ' 

PRESCHOOLS 

Three preschool -programs were conducted in Maui Distri9t during the past 
academic year. The programs were on Lanai, at Harta and. at Puunen^|||With each 
designed to serve twenty presr ooleis. The parents Of these sixty children 
^ all requested that their children be allowed to particip^ite in the program. 

As' available standardized tests for the purpose of selection criteria are not 

• . ' ^■ 

sufficiently reliable when applied to three and four year old youngsters, 
much^of the basis for final selection was subjective in nature. Individual 

. : 14 ■ 



pupil needs and the home environment, however, w6re carefully taken into 
consideration during the selectiori procedure^ 

-The pifeschool programs wete^ organized and designed aroUnd the concept, 
of providing these children the opportunity tp gain the necessary social and 
acfdeiAic abilities required in kindergarten and the early elcimentary grades. 
Such abilities as socio-emdtional, psychomotor, cognitive,' and language 

^ ' / ' ^ ■ y : 

development were the focus for t^ese preschool projects. The gpals of , / 

1^ * ' ./ 

preschool education and child development ^re to a^) promote and enhance the 

social and pfersonal , development of the chUa, b) instruct' the child in/the 

ipitiaf academic disciplines necessary for his pitegressl^e success throughout x 

the elementary grades, c) provide the nutrition, recreation, social interaction, 

and supervision the child requires and cannot find^within.hia home envir;on« 

ment, and d). supply the necessary situations through which his natural 

exploratory actlv^j^y may readily occur. 

Each preschool classroom was comfortable, clean, well diecorate5 with 

art work and pictiifes, apd supplied with sufficient instructional materials. 

All children engag^ in play activities, physical exercises, nap^time, lunch, 

apademic work, and Social interaction each day. The significance of the 

personal and social experiences which lead to childhood maturity were, in all 

likelihood, equg^l to the individual's growth in academic ability. In all three 

programs /however, the children improved faster in the areas of colorsC^^^"^\ 

' ■ i ' . ' ' 

numbers,^ shapes, and locomotive skills, and le^s quickly in the more formal 

academic areas such as the identification and naming of upper and lower 

alphabet^ and following directions. • ^ 

As most of the preschool objectives (as stated in the project proposal) 

are highly subjective in nature and do not lend themselves to statistical 

evaluation, no precise interpretation can be made regarding their attainment. 



All sixty pupils, nevertheless, did meet^and surpass thos^ objectives which 
are subject to accurate measurement. Th^ pre"^ and post- test data generally 

indicate that all objectives were probably met, for the success of these ' 

1 - . " . ^ ^ 

programs and the. achievement of these pupils was remarkably high. 



r 
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MEASUREMENT OF ACADEMIC GAIN ; §1^' 
^Peabodv Individual Achievement Test* 

The Peabody Individual Achievement Test (FIAT) was/ administered to each 
Title I pupil as arpre- and post-test, In Sepl:ember an^ May respectively.' 
The changes (Increases or decreases) betweei^ these two sets of scolelft presents 
an overvlew^of the scholastic attainment of the pupils. Administration of , 

• . .i ' • - 

the FIAT provides- a wide-rapge measure of achiev^ent in the areas* of 
mathematics^ reading,- spieljing,* and general information.. 

The mathematics subtest measures the pupil's pbij.it^ to apply mathematical 
knowledge to the solution of ^practical computational problem^. This subtest 
does nota require writing or oral respdtises and, as the first subtest presented, 
enables the tester to establish a good. rapport with the pupils . The reading 
recognition subtest measures the pupil's ability to translate sequences of 
printed alphabetic symbols which form^words into speech s0unds that can be 
understood by others as words. 

' • • • ; , v.- ■ - ^ • i- 

Th^ reading comprehension subtest measure <;he individual's ability 

to derive meanitig^^fM printed words. The format includes a series of 

sentences of increasing difficulty from which the pupil first reads a passage 

•* 

and then sel^ctis from four illustrations the one that best conveys the 

ti 

meaning of the passag^. The spelling s^itStest measures the pupil's ability 
to recognize correctly spelled words. '^I^do this the pupil selects, in 
response to verbal cues provided by the tester, thecoxrect' One of four 
similarly printed wbrds with slight variations in spelling. \ The fifth 



*Dunn, Lloyd M. , & Markwardt, Frederick C, Jr., Feabody Individual Achievement 
Testj^ American Guidance Service, Inc., Circle Fine^, Minnesota, 55014, 1970. 
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^ subtest, general infffmiatlony measures the extent to which the pupil has 

apqulred knowledge relating to himself and his environment. This subtest - 
con^sts of openVended' questions that relate to general encyclopedic knowledge. 

The Peabody Individual Achievement Test was chosen as the standard 
measuring Instrument for use with Title X Rtffli^c^ because of its numerous ' 

, ■ . ■ ■ ■• . ^^t • ■ J / 

characteristics which enhance its utility as a'ideasuf'e of scholastic 
aohievement, Fi^rst,. the PIAT was designed aa an individually-administered 
test. As group tests arcKable to -measure only a relatively narrow range of 

V ■ ■ '.• ■ ■ - ■ 

i grade levels, or a^e-:<liagnostic instrutftents in a specific subject matter, the 
PIAtjjs not prone .to these limitatipnsi ^ The test enables the examiner "to 
establish a personal relationship with the pupil that helps to elicit a more 
optimal performance from him, especlal'-ly ^en the pupil is less, motivated toward 
school and academic achievement. The PIAT, as an individual test, also allows 
closer. monl^l^r^ng of pupil behavior, encourages les^ guesswork, and permits ' 
// more accurate measurement of the achievement exhibited by immature and under* 
y achieving pupils « ^ 

/ " ■ ■ • ■ 

7 The PIAT Is^ a wide-range Instrument extending from kindergarten through 

^ high sclipol, with the items arranged in order of difficulty. This feature 
makes it possflble to locate quickly, and administer only, those'parts of the 
/ test that are within the critical range of difficulty for the pupils. With 
^ this attribute, some of the major faults of group tests are avoided: boring 
brighter students xd.th items which are too easy for them, and frustrating 
slower one^lrith items beyond .th^|y Sabilitie^s. 

A third advantage of the PIAt Is'^'^that it was designed to be, a screening 

' * • . . -' '^ ^%^{„. . • ■ * , ^ - • . ^ ■ 

test which could be quickly administered atid scojfgd, . tjrpically taking only, 
thirty to forty minutes. No special l^ad pencils,, computer programming, or' 
sets of coded scoring stencils are necessary. The pupil's successful progress 
through the test is scored at the same time he is being examined, 

■ ~ ; 18 ■ ' 




The PIAT is an untimed, power test. An emphasis on speed would be a 
^ considerable handicap for most underachieving or disadvantaged Title I pupils. 



Th^iest items were not sel^ted ' from specific techniques or concepts but were 
balinced across traditional, modem, a^d functional aspects of the general 

. ■ • V ' •• V ' ^ 

curricula. This important ctiaracteristic of the PIAT minimizes the bias result 

■ ^ . ' ' M 

f ^ 
ing from the particular instructional approach to which the pupil was exposed. 

Bather, the PIAT test items meas^ure functional knowledge or abilities that are 

widely-expected educational outcomes. \ 

Of particular benefit to Title I projects is that the Pli^^as designed to 

be most sensitive at the lower grade leVels*and to decreas^. gfadually in y 

sensitivity with advancing grades. THis was done with the belief that the 

PlAT-would be used more often with students whose achievement is at the lower 

level of the test range. " ^ ' 

A seventh valixable jispect of the* teit is that demonstration and training 

> ... # , ^ ' . ■ • 

exercises are included to^ ^.ntroduca each sybtest to the pupil, thus insuring 
some initially successful experiences for him. ' These exercises are also used,, 
to teach the pupil the type, of respbnses which are expected. Completely _ ^ 
objective scoring, which is easily accomplished while the test is bfe^ng 
administered, is built J^itp 4:hree of the five subtests which are in multiple- 
choice fommt, and precise standards are provided on the other two to reduce 
y^^Scoring variability. ^ 
jt. Of m^jor significance Is that t^e PIAT subtests are designed so that no 

^^^academic skills are required other than those specifically being measured. - 
The mathematics and general information subtests, for example, are made fairer 
for the pupil with reading difficulties in that no reading is required. 
- "Furthermore, the pupil does no writing on any subtest since this bften^ inhibits 
his performance and motivation. The PIAT format, illustftitions, and content 
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were also specially selected^ hold the interest of pupils of both sexes, 
from a wide variety of ages, and from differing cultural backgrounds. ^ 

Most itaportant for its accurate interpretation, /the PI AT was carefully, 
standardized nationally on a sample of 3,000 pupils in the mainstream of 
public^ education. The sample of pupils upon which the pdrms are^ased were 
chosen in proportion to the population of school-age children and^based 6n the 
1967 projected data from the Bureau of^ the Census. The standardization, 
conducted in 1969, -accounted for diffei^ences o^ sex, age, race, socio-economic 
status, and urban ,^ Suburban, , and rural communities. • All, test administrators 
received extensive training on testi^ng and scoring procedures t^bm^ the' 
American Guidance Service, Inc. y : . ^ ' ^ V 

The twelft^K distinctijje aspect. of this .test is that exterlive formal 
preparation' is not required for its administration. The PlAT ^anJ^r^adminis- 
tered by any professional person interested in measuring the academic 
achievement of pupils. Furthermorci, the testing procedures are Sufficiently * 
oblective so that non-professiondl assistant^^ under supervision ^.^nay alsb 
administer the PIAT. Such advantages as thwe maJjte the Peabody Individual ^ 
Achievement Test a sound ^d justified choice for use in evaluating the, 
scholastic attaipment of Title I pupils in Maui District. 
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dLa "PRESENTATION & EXPLA^TIOfJ OF TABLES . • ^ 

■ ^ ■ ■ /. (- ■ ' • " ■ ■ 6- 

A gineral undei^tanding of tl^e statistical data is required before any 
portion of it can be Applied to sp^ific projects, and a concise explanation 
of these tables is provided. ThiS^description of the tabled data does jiot 
^— ^fc«iu8s individual progijams or their specific achievement rates ^ but inter- 
prets how the data was used fox-this purpose.^ A school-by-school examination 
«f each project, as well- as data tables relating to indivi<^al projects^re 
.presented lanedlately following this section of the report. 
" 4, , ^gflmh, any test, raw scores flqcfeuate according to the number of test . 
> items and the aliility of the individual s'^eiog tested. Raw scores, by them- 
selves, cannot be meaningfully interpreted. The Peabody Individual Achievemetft 
Test provides four types of scores whtch were de^^ved from the pupils' "'^j)- 



scores during the time of test standardizatiorif The^e derived scores are ^ 
.1) grade equivalents, ?X age equivalents, 3) percentile rjanks, and 4) standard 

Scores. ^ \ * 

' The SWDW; elected to ase the fi^rst index o\^ measurfement||^th-e^rade 

•I \ ■ 

equivalent scores, as these aire the mbst familiar to teachers, more readily 

' understood Tjy educators, and least subject to Statistical misinterpretation.* 
While using grade equivalent ^cores -as the basis of statist?ical evaluation, 
the tabled data further minimize posiible misunderstanding by includin^llnly 
the ^aine achieved. The actual gra^ levels the pupils were in and their 

* grade equivalent scores achieved on pre-testing would, like raw scores, 
fluctuate among projects and therefore be more difficult to compare and 
understand. It cannot be determined, in other words, whether a fourth grader 



★Teachers are cautioned, however, not to use the PIAT test data as a diagnostic 
test. The derived scores indicate the most appropriate grade level yat which 
the pupil would function as an average student. \' 



with a 3.8 grade equivalent score achieved more or less than a third grader 
with a 2.1 gradei equivalent score. Only t^e difference between the pre- .and 
post-test scores/ (i.e., gains) can give this information. * 



PRE- ApP POST- TEST ttESULTS OF PIAT . 
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The data pre^rented on Table 1 indicate only indirectly where the 
pupils were at the Uieginning of the year and where they were at its end, 
with the significance of evaluation based on the g^ina dr losses (+) attained 
dur^g the year. The data, presented /in subsejiuent tables, of grade 
equivalent* scores have therefore been refined into average monthly gains . 
The average gain per month was established by sub^ractflig the pre-test . 
scor^ from the post-test ^core, and dividing this by the tlumb'er of*months 
between pre- and post-testing* 

All test data from the PIAT are presented in average monthly gains 
in grade equivalent scores . The primary objective of most projects was for 
the pupils to achieve an average grade equivaletit score greater than .1 

per month. Achieving Jess than .1 per month would suggest that the pupils 

♦ * 
were falling further behind their non-Title I peers, and a .1 pc^r month 

rite of achievement would indicate they were falling no further behind 

than where they were at the ^eginnijig of the academic year, A fifth grader's 

grade equivalent scores of 3.7 ii^||||lept ember and 4.7/ in May would imply that, 

after a year's work, he is still over onVyfear><6ehind the typical pupil in 

his grade level. For remediation to be. successful the academic jfains must 

be greater than those made by other pupils. 

Another way of understanding the average monthly gaink in reference to 

the .1+ per month objective is to view the data as manth-per-month gains. 

A project's pupils who achieved a .13 average monthly gain in effect^ 

achieved one and three- tenths months for each month (or one-tenth) of ^the 

academic year, thus gaining .03 per month in addition tfo the ..1 per month 

required of the grade level a whole. In this case, the Title I project 

whose. average monthly gain was .13 attained an achievement rate of one year 

3 



2*^ 



)ther pupils. 
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in maintaining tHe pupils ability commensurate with that of other pupil's 
in his grade, and three-tenths of |^^ear (.03 X ten) in remediation , 
end of the year the pupils were, /on an average, » three-tenths of'^a grade 
level closer to functioning "on average" with noil-Title I/pupils. This 
theoretical group ofjaiii^ils, therefore, were no^ otily keeping up with other 
pupils but decreasing the gap between their academic abilfity and that^ of 

Vo, . 

Whil« grade equivalent ^scores are relatively easy to understand, they 
should not be accepted as proof or absolute fact: Testing, error by the test 
administrator may result in scores which are neither accurate nor reasonable. 
The standard error of measurement (reliability) an^ standard error of 
estimate (validity) of the test may also contribute to scores which are not 
"true" or perfect. Thus, all derived scores, such as grade equivalent scores 
are approximations of the true score. When an individual attains a 2.3 grade 
equivalent score it is not proof that he is functioning at exactly that 
level. The scbre represents ceiling achievement o^the pupil's upper limit. 
An independent functioning level may' be within a range of half a year to one 
full year bttlow the given score he is probably able to function. It is for 
this reason that PIAT scores, like all achievement test data, should not be 
u^ed for diagnosis or prescription of individual work.^ 

By averaging many scores, howev^, the range of probable true scores 
for the group as a whole is considerably reduced in size. (Although no 
correction for testirig error by the administrator is possible.) More 

reliability can therefore be placed upon the tabled data than would be 

» . * , ■ 

possible when examining just one pupil's score, for while his individual 
score would be likely to change somewhat upon immediate retesting, the^ 
group's average score would not be equally subject to the small variations 
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within the group. Tiie^if ferences between each puj^il's first and second 
set of scores would tend to balance out and retain the same, or nearly the 
same, group score. 



The effect averaging scores has the inher€n^. drawback of using 



numbers that must be rounded off. For ^ome data^his may cgpstitute losing 
information, while for another case the fine measurement of a hundredth or 
thousandths place would not be necessary. Average monthly gains which are 
within two hundreds of a ^ivtt to ort^ another are not significantly different, 
and may be due to chance. jSuch differences should not be accepted as precise 
fact, b^ as an indication of the probable academic success" that was 
attained. . . . 

. • t ' ^ ' 
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TABLE 1 



READING resource' ROOMS 
Pre-Post Results: ^Peabody Individual Achievement' 



SCHOOL 


NUMBER OF 
PUPILS 


MATHEMATICS 


, READING, 
RECOGNITION 


READING 
COMPREHENSION 


SPELLING 


GENERAL 
INFORMATION. 


TOTAL 
SCORE 


Haiku 


' Pre 


Post 


Pre 


Post 


+ 

m 


Pre 


Post 


+ 

■* 




[141 




Pre 




+ 




Po9t 


i ' 


Pre 


Post 




11 
ji 






1 9 


1 fl 


9 1 




Q 

lO 


Z.U 


Z.D 


c 

.0 


2.3 


3,3 


^0 


2.4 


3.8 


1.4 


2.2 


3.1 


.9 


Kaunakakai 






1 /( 


Z.U 


• 0 


1 1 
1.1 


1.0 


.5 


c 

.5 


1 A 

1.4 


A 

.9 


2r2 

</> 


1.8 


.4 


20 
J- 


1.4 


-.6 


,9 


1.7 


.8 


/ . 










1 ^ 
l.D 


9 7 


L ft 


9 1 


1 1 
i.J 


/. /. 
'i.'i 


3.1 


2.2 


4.0 


1.8 


. 2.4 


4.0 


2.2 


2.j 


4,5 


2.2 


Kllohaj/a ' 


33 


40 


2,8 


3.5 


1.1 


2.1 


3.0 


.9 ■ 


1.8 


2.7 


.9 


2.1 


2.6 


.5 


2.2 


3.2 


1.0 


2.1 


2.8 


,7 


Kula 




if 




J*? 






9 Q 




1 n 


9 ^ 
Z.D 


1 c 
l.D 


1«J 


Z«t) 


1 1 
1.1 


1#5 


h 

3.0 


1.5 


1 r 

1,5 


2,8 


1.3 


Paia • 


29 


29 


1 9 






1 


9 A 


Q 


1 -n 
l.u 


9 A 
Z.4 


1 A 


liD 


9 

Z.J 




1 

.1 


1.0 


I.J 


1 0 
1.2 


2.1 


.9 


Waihee 

> 


31 


30 


2.4 


3.2 


-.8 


2.2 
! :a 


3:2 


1.0 


1.8 


3.0 


1.2 


2.2 


3.0 


^ .8 


1.9 


3.0 


1.1_ 


2.1 


3.0 


.9 


Wailuku 


53 

— 




1.9 


3.2 


i.3 


1.9 


3.9 


2.0 


1.2 


3.4 


2.2' 


1.8 


•3.4 


1.6 


1.5 


V 


1.6 


1.'7, 


3.3 


1.6 


DISTRICT AVERAGE 


32./I 


31.7 


2.1 


3.2 


1.1 


1.9 

] 


3.1 


1.2 


1.3 


2.8 


1.5 


2.0 


2.9 


1.0 

• 


1.8 


3.0 


l;2 


1.8* 


2.9 


1.1 


,. ■ ■ ■ ' ^ . 
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AVgRAGE MONTHLY GAINS 

> . * * > 

The first table of data presents the pre- and post-test results and the 
gain achieved during the year by each readlng'^^rSource room. Immediately to 
the .right of the schools Is Indicated the number of pupils, followed by the 
scores for each of the five PIAT subtests. Table 2 also lists the schools^ 
In alphabetical order, but Indicates th^, average monthly gain In grade 
equivalent score that was. achieved. In all excep^one of these eight projects 
a few pupfls moved out of the local school area or, for varloiis reasons,, left 
the Title I program during the school ^ar. N 

The pupils who left and the newer pupils who were admitted to the programs 
did not receive both pre- and post-tests^ In addition, some pupils were 
not post-tested due to absence from school during the last week of testing. 
According to the prbjected enrollment of all Title I projects, 25 pupils 
Lil3^%) were not tested at the beginning and end of the year. 

That some, pupils were not fully tested is an Important , factor when 
comparing the projects' Total Score monthly gains with the average monthly 
gains in the last column of Table 3. The Total Score of the PIAT was based 
on the number of pupils taking the test; and with this number differing 
between test administration the Total Score was not always equivalent t<^ the 
average monthly score. The average monthly gain represents the Igain achieved 
by pupi^ls who receive^d both pre-^and post-testing. 

The graphs depicting the average monthly gains on the five PIAT subtests 
(see individual project descriptions) show these scores for each program and 
the Maul District averages. Each project's achievement/ can b^ seen in 
relationship to the average of similar projects, with the achievement of its ^ 
pupils being above, equal to, or less than the entire District. The overall 
average does not , however, represent a stancfard criterion'. It is not a goal 

. 28 - ■ 
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to reach, nor a measure of program efficiency, A project whose academic 
achievement was above' the average does not necessarily me^ tTie project was 
more effective than others, and a project whose pupils' achievement fell below 
the average does not confirm that ±t was a less effective program . Comparative 
analysis among projects must be interpreted cautiously, for wBile one program 
may have succeeded ^^th fifth grade children and another achieved less with 
third graders, either one may have initiated the remedial \/ork with less motivat- 
ed pupils, a smaller budget, poor facilities, lesser parental support, or 

with pupils further behind in their previous acadeinic achievement. One project 

'■ ■ . . . 

averaging less this year may, in following years, mihieve more. ^ 

* 

Nevertheless, the relationship between each project's gains and tlie ' 
District average does represent the genferal strengths and weakness of project 
achievement, especially where these gains are relatively largef The larger 
the gain, as presented on the graphs by the distance from the Average, the 
more confidence can be placed in the assupiptic^ that these differences are real 
and due to actual program effectiveness. Scores which are higher or lowe* 
by two-hundredths.of a month's gain (equivalent to two-tenths of a year's ggin) , 
when compared to the District average, may be -considered initilally reliable. 
Differences between subtests, however, must be viewed more cautiously, , for the 
different subject matter tends to be learned faster^r slower by children of 
differing ages. 
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TABLE 2 • . 

READING RESOURCE ROOMS 
Average Monthly Gatn In Grade Equivalent Scores by'Schpbl 



SCHOOL 


Puptls 
Tes ted 


cMath. 


Rdg^ 

>Rec^ 


Rdg. 

Compv 


Spell. 


<J. Gen.. 
Info. 


Total 


Ha Iku 


JC 


1 'X 


• 11 


OR 


i -13 


1 

■ . 19 


.12 3 


Kaunakakai 


cl 


HA 
• UO 


• 


• v7 


.04 


'- .06 


'.S8 


Kihel 


OA 




• CO 


• 39 


.23 


.28 


.28 


Kllonana 


OQ 
47 






12 


• 07 


.13 


.09 


KUla 


24 


.18 


.16 


.19 




.18 


.15 


Pala 


29 


.08 


.11 


.19 


.12 


.20 


•12 


Waihee 


30 


• 08 


.10 ^ 


.12 


.08 


.11 


.'.09 


Walluku 


44 . 


• 17 


.27 


.29 


.21 


.21 


.21 


DISTRICT AVER, 


233 
(total) 


• 13 


.15 


.18 


v>^.13 


.16 


.14 
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. TABLE 3 
READING RESOURCE ROOMS 



Average Monthly Gain^in Grade Equivalent Scores by Grade Level 



SCHOOL 


# PUPILS 
TESTED 


. GRADfi LEVELS 


K 


1 


2 , 


3 


4 


5 


6 


7 


8 


9 


Average 


Haiku 


^32 




.10 


.11 


.07 


.11 


.19 


.15 


.07 


.18 




.125 


Kaunakakal 




21 




.08 


.09 


■.08 


.04 


.04 


.05 








.076 


Kihei 


24 








.15 


.21 


.26 


.33 




• 




» . 249 


Jlilohana 









.14 


.07 




.16 


.10 








,123 


Kula 


24 


.09 


,15 


-.15 


.14 


.26 


.17 


.16 








.155 


Pala 


29 




.11 


.13 


.08 


.07 












.106 


Walhee 


30 • 




.14 


.05 


.08 


.09 


.09 


.14 




.11 




.100 


Wailuku 


44 




.24 


.23 


.22 














.230 




























DISTRICT 


233 
(Total) 






1 


! 














.146 



RANK OkPER OF GAINS BY PROJECTS & GRADE LEVELS ' . 

* ' . 

Tabl6 4A presents the rank order of project components by their average 
monthly gain achieved. Like all PIAT test data, these gains are based on . 
grade equivalent scores, with the difference between pre-. and post-tests being 
divided by the avetage niomber of months (per project) between testing dates. 

Table 4, concerning* reading resource rooms, indicates the rank order of 
grade levels according to their respective average monthly gains. No consistency . 
of achievement through grade levels' was evident, with this due to the heterogeneous 
classification of grade levels throughout all eight projects. That is, most 
projects, whether more or less effective than others, served most grade levels, 
and the specific grade level gains, by one were balanced by those of another. 

That pupils in kindergarten, ^^^^^ seventh and eighth grades achieved 
lower learning rates does suggest, however, that the youngest and oldest 
pupils were often unable to benefit as much from the projects as were other 
children. The individualized instruction and jjiat4vating techniques were 
apparently less effective for these "harder to reach" pupils. The results 
this year, further, are a reversal of the 1972-1973 outcomes which showed, the 
sixth graders making the least gains. The present result shows that the fifth 
and sixth graders ranked first and second respectively, indicating significant 
Improvement for this ^r cup of target students. 

/ 



TABLE 4 

t 



READING RESOURCE ROOMS 

Rank Order of Grade Levels by Average 
Monthly Gain Achieved 



GRADE LEVEL 


AVERAGE MONTHLY GAIN 


5 


.188 


6 


.171 


4 


.156 


3 


.155 


2 


.144 


1 


.111 


7 


.110 


8 


.110 


K 


.090 



TABLE 4A 

Rank Order of Projfl>ct Components by Average 
Monthly Gain Achieved 



SCHOOL 


AVERAGE MONTHLY GAIN 


mhei 


.249 


Waiiuku 


.230 


— " c 




Kula 


.155 


Haiku 


.125 


Kllohana 


.123 


Paia 


.106 


Walhee 


.100 



Kaunakakai \ ^ >076 
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AVERAGE GAIN DURINQ INTERVENTION ' 

V \ ■ ■■-^^ 

Among the various tables of PIAT data^ and numerous graphs of subtest 
scores, the most valuable and comprehensive information is revealed in Table 5, 
First are listed, in alphabetical order, the Title I schools during the past 



ERIC 



academic year. v. To the right of « each sphool are the average monthly gains of 

"lis ' ; 

the pupils in that school's project before the beginning of the academic 
year. ^Xo determine this, baseline figure each pupil's pre-test T6tal Score was 
divided by the liiamber of months of academic instruction which he had received 

up to that tim%»^ A fourth grade pupil at the September pre- testing would 

\> ■ 

have bee»*J.n schdol three years, or thirty months - excluding kindergarten. , 

' ■ ••■ . ' " ■ 

Achieving/ a grad« e'qjjivalent score of 2.0, his average monthly gain, or base- 
line rate, before the Title I program began would have been .07. Every pupil's 
baseline ^rate established, and averages for each project were 

recorded. ' ^ ^ .. ' 

A ^tSiilar -^procedure was used l^o dete^ailne tlie^pupils' average monthly 
gains during t^^i^Vl^articipation in the Title I-project. Each pupil's pre-test 
Total Siqpre wa^subtracted from his post'-test^Total Score, and the difference 
divided by the number of months (to the nearest half-month) between testing ; 
periods i^^^^'ror most projects there was a seven or seven and one-half month 
interval, these second-column figures show the actual academic gain which was 
attained by the typical pupil in each project. 

Immediately to the right of these numbers is a third set of figures, 
with these representing the most significant of all PIAT data. This last 
column in Table 5 shows the increased learning rate of the children for which 
each Title I project was largely responsible. When considering testing and 
academic achievement only, these figures provide the most direct means of 
assessing program effectiveness. The increased rates of learning, which are 

34 
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In addition to the baseline learning rates of the pupils prior to the programs' 
beginning. Indicate the relationship between what the youngs tera^ were achieving 
before their Title I experience and during their remedial Instruction, The 
greater the Increase In learning rate the faster the pupils were achieving an 
academic ability equal to non-Title I children. Similarly, with higher 
learning rates the .better these children will be able to function within the* 
mainstream of jschool actlvltl^ In coming years, and, essentially, the more 
effective was the Title I program. 

The statistical figures of Table 5, as high ad they are, represent only 
the total test score of the PIAT. This average s^re of the five subtests 
reflects the necessary and critical emphasis which Individualized Instruction 
in remedial reading must have within each school, for a fundamental ability 
to read is a prerequisite to academic work in general. Since the emphasis 
within readingVresource rooms was placed on reading, the pupils attained their 
greatest gains on^ the subtests ^of reading rerognitlor and reading comprehension. . 
The Total Score, howler, was not Increased to its .15 average just because 
the two reading subtests were high, for the pupils also achieved learning rates 
in mathematics, general Information, arid spelling which were most frequently 
higher than their baseline rates. The pupils, whose average gain in reading 
was 1.7 years, could from their reading Improvement better comprehend mathematical 
probletos, understand and absorb, more knowledge of their environment, and 
recognize and recall the correct spelling of more words. The emphasis on 
reading resulted in an overall Improvement throughout the spectrum of academic 
knowledge and ability. 



TABLE 5 
READING RESOURCE ROOMS 



Pupils' Average Monthly Gain Be^pjre & During Their Program. Par ticipa 



SCHOOL 


• 

BEFORE PROGRAM 
PAT?TTCIPATION 


DURING PROGRAM; ' 
PARTICIPATION 


, ' INCREASE 

>• 


Haiku 


.06 


.12 


• .06 


Kaunakakal 


^ - .05 


.09 


.04 ^. 


Klhel 


.07 


7. 


.18 


Kllohana 


.08 


.12 


.04 


Kula 


.07 




.08 


Pala 


.10 


.10 


0 


Walhee 


.07 


& .10 


.03 


Wailuku 


.10 


.23 . 


.13 


DISTRICT AVERAGE 


.08 




.15 


.07, 



36 

o 

ERIC 



30 

ACHIEVEMENT OF CRITERION . * 

The last of the tables Involving FIAT data from reading . resource rooms, 
Tabl^ 6, indicates the percent of pupils in each project whose achievement 
during the school year was above their baseline rates and,, secondly, above 
.1 average monthly gain. The number of pupils listed is the number who were 
both pre- and post-tested. These percent figures represent those pupils who 
were above their baseline rates and average monthly gains. As the individual 

■ - r 

baselines were nearly always below .1 monthly gain, the percent of ptipils . 
surpassing theit baseline rates tended to be greater than the percent reaching 
the objective criteria of .1 per month. 



TABLE 6 
READING RESOURCE ROOMS 



V 



Percent of Pupils ALbove Baseline Rate & .1 Average Monthly Gain 



SCHOOL 



Haiku 



I NO. OF PUPILS i PERCENT ABOVE 

BASELINE RATE 



32 



81 



PERCENT ABOVE 
.1 AVERAGE 
MONTHLY GAIN 



59 



Kaunakakai 



21 



71 



19 



Klhei 



Kilohana 



Kula 



Pala 



Walhee 



24 



29 



24 



29 



30 



100 



66 



92 



66 



77 



100 



55 



83 



59 



33 



Walluku 



44 



98 



DISTRICT AVERAGE 



233 (Total) 



82 



98 



66 



• . 32 

ESTIMATES FO R IMPROVEMENT IN BEHAVIOR 

^ ~ ~ 

Table 7 presents the final results from the Project Teacher Behavioral 
Estimate Form. The scores, listed by the school of the T^tle I project, are 
the average pupil scores per question. A YES response on the estimate form- 
was assigned two points, anJ^CERTAIN response one point, and a NO response 
no points, with an average s6ore j^er question o£ 2.0 being the highest possible 
and zero being the loi^3t. 

The table immediieit^ly following these final results. Table 8, shows the 
pre-post increases from the estimate form. (For 'the initial results of these 
estimates, see Table 6 of the SWDRC Mid-Year Progress Report for 1973-1974.) 
As the name of the behavioral estimate form implies, this measurement of pupil 
behavior was a subjective estimate at best. No assumptions regarding, its 
validity or reliability can be made, and no concrete conclusions may be drawn 
from it. 

Nevertheless, a notable aspect shown in the results from Table 8 is that 

questions two, five, and eight ("Good study habits'?, "Completion of assigned 

tasks on time", and "An ability to follow directions accurately" ) had the 

greatest increases, while the third question ("Good cooperation with project 

teacher.") had the least increase of any question. The subjectivity of 

estimating becomes most obvious with this diaparity, for while the pupils 

increased their work and improved their study habits, they weren't, apparently, 

"doing what the teachers wanted . - The- -l<)w .-r of pupil cooperation probably - - 

reflects the level of frustration felt by teachers, and has little to do with 

' " • ■ 

whether the pupils were actually cooperating or not.- That the pupils improved 

■' - ■ . ■ ^ 

their work and behavior, however, is' firmly supported by the evidence of their 

tested achievements. " * 
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TABLE 7 
kEADING RESOURCE ROOMS 



Final Results ftom Project Teacher Behavioral Estimate Form 



Average Pupil Score Per Question 
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TABLE 8 

. • I^ING RESOUKCE ROOMS 

Pre- Post Increases Prom The Project Teacher Behavioral Estimate Form 



Based on Average Pupil Score Per Question 
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PUPIL ATTENDANCE RECORD 

Table 9, concerning the pupils^ attendance records, readily shows that 
none of the projects achieved the criterion for improving school attendance. 
In fact, a number of schools* TlCle I pupils actually worsened their school 
attendance as the year progressed. On an overall basis, the total school 
population of the State annually shows a gradual drop in attendance as the end 
of the school year approaches and the individual records of ESEA Title I 
pupils are usually compatible with the g«aeral population. Only Kaunakakai,^ 
Kula and Waihee Schools maintained a somewhat stable attendance record which 
is t3rpical of the statewide average for all schools. Kilohana and Wailuku 
decreased slightly while Klhei and Paia Schools shows approximate decreases 
of 1^15% between the Fall and Spring attendance counts. Haiku School's, 
drastic reduction from the 78-81% range 'to 25% was reported to be due to the 
pupils* illness during the spring months. 




TABLE 9 
READING RESOURCE ROOMS 
Pupil Attendance Record 



SCHOOL 


AVERAGE PERCENTAGE RATE OF ATTENDANCE 
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LEISURE & ENRICHMENT READING 

) ■ ■ ■ , 

The last table of data concerning reading resource rooms presents Informa- 
tion regarding the number of books which the pupils read during the first • 
and last two months of the school year. The data shown J.n Table 10 was not 
very reliable or a truly accurate measurement of pupil reading Improvement. 

Second only to parental Involvement, the Measurement of pupil behavior - and 

> 

especially their reading of books - was the most difficult tro establish. Such 
reading may not only occur at any time, and be a private affair of the 
Individual pupil, but the teacher herself cannot often judge whether the pupil 
really read the book or not. The teachers^ subjective judgment had to be 
used In estimating what kind of reading occurred (e.g., skimming, recognizing 
familiar worHs, or comprehending) and how difficult the book was. 

In some cases the number of jk>oks read Increased sharply, due to greater 
Interest, ability, and motivation by the pupils, and because the books were 
of equal difficulty. In othe^/projects the number of books read decreased, 
due to a similar Interest, ability, and motivation, and because the books 
Increased In length ^hd difficulty. It can be assumed from the PIAT test 
results, however, that reading ability Improved and that reading content Increased 
In difficulty within each project. * 
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TABLE 10 
READING RESOURCE ROOMS 
Average Number of Books Read Per 



1 — 

SCHOOL 


NUMBER OF PUPILS 


FIRST 2 MOS. 


LAST 2 MOS. 


Haiku 


; 
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Kaunakakai 
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30 
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• ' ■■ ■' ■ 
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-St-': 


5.2 


7.9 
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■ , ■> • ' 
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PRESCHOOLS; TE^T OF EXPRESSIVE LANGUAGE . e 

The Test of Expressive Language (TEL)* Is a short, easily administered 
Instrument for evaluating the level of expre)5slve language functioning of 
children. The child Is required to respond verbally to a series of graded ^ 
questions about himself and his immediate environment* The TEL consists of 
seventy*flve Items that can be administered In about fifteen minutes to ^ 
chljdren between three and seven years of age. 

The results from this preschool Test of Expressive Language are presented 
In Table 11. The norm scores are standardized scores derived from the 

. ^ 

properties of the normal probability curve and preserving the absolute dlf- 
ferences between scores. The TEL norm score (z-score) Is 100 or a value of 
zero. The greater the distance (above or below) from "100", the wider the 
gap from the mean score. 

While all three preschools at Hana, Lanal, and Puunene achieved norm 
scores well above 100, precise assessment of whether they met their objectives 
was not possible. The norms for the TEL were, established for "economlca^Lly 
disadvantaged" preschool pupils and the Title I criterion for preschool partici- 
pants was primarily for the "educationally deprived"-' Further, a considerable 
number of the pupils at Lanal and Puunene came from families of foreign-born 
parents which Indicates cultural-language disadvantages Inhibiting successes 
at school. 



*Crowell, Doris C. , Fargo, George A., & Noyes, Mary H. > Test of Expressive 
Language, University of Hawaii, 1969. 
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PRESCHOOLS: CHECKLIST OF BASIC SKILLS , 

Table 12 shows the pre-post percent of criterion success achieved by the 

\ 

preschool pupils on the Preschool Checklist ' for Basic Skills. While increases 
were significant for all three projects, the I^anai project exhibited slightly 
greater gains, probably due to the academic orientation of the project 
teacher. (Note: The new Lanai preschool teacher was a former kindergarten 
teacher in the HEP classroom at Lanai Elementar^t School.) Another explanation 
for the lesser increases by the Hana preschoolers was their generally higher 
pre-test scores which were, on the average, 6% greater than Lanai' s. The 
Puunene children, although achieving the highest pretext scores (31%) failed to 
exceed an average of 51% for the post-test.. 

The Checklist of Basic Skills did not attempt to measure the pupils' 
growth in the affective domaitiC^ The lack of such a measurement may have 
been to the disadvantage of preschool projects emphasizing this area. The 
Puunene project, never-the-less, achieved significant and respectable gains 
'in the skill areas that were tested. , 
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TABLE 11 

RESULTS FROM PRESCHOOL TEST OF EXPRESSIVE LANGUAGE 
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Pre-Average Norm Score 


\ 1 f\0 






Post- Average Norm Score 


. f 






Average Norm Score Increase 


¥ p 






Pretest Average Score 


j-^ • 




9*^ ft 


iTLecesu nVcLogc ireLCciii. l>ollcl.u 


4? 7 


25 7 


31 7 
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Posttest Average Percent Correct 


82.9 


68.5 


58.5 


Increase Pre-Post Percent Correct 


40.2 


42.8 


26.8 . 
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TABLE 12 



PRE-SCHOOL PROJECTS 

Pre-Post Percent of Criterion Success Achieved by Pupils on 
the Preschool Checklist for Basic Skills 




ASSESa^ENT OF PROGRAM 



The assessment of various components of the Maul District ESEA Title I 
projects are presented in alp^abetlcal^r<^et or th^ schdol^projects. Each 
project component was evaluated on ^J^^^asls of^ the following orJ^gi^^l and 
revised project objectives; (R^^tftp the Mid-Year' FyWe^ss Report , SWDRC 
Report #127, for additional ifl^tf|ills regarding the goals and objectives). 

• " ^ ■ ^ . -/"'^ ^ . ■ ' . 

Objectives for Reading Resource Rooms » 1973-1974 



Schools : Haiku School 

Kaunakakiai Elementary School 
Klhel School 
Kula School 



Paia School 

Walhee School 

Wailuku Elementary School 



Revised Objective # 



]rt._:5Xrfifidard Test Sco'res will Increase, on the average, to 
a learning rate greateivthan .1 average monthly gain 
in grade equivalent scores for reading recognition and 
reading comprehension between the pre- and post-tests. 



Revised 




ve #2: The amount of enrichment reading done by the pupils, 
;^ as indicated by the number of high interest/leisure 
redding or non-text books, will be increased between 
the Fall and Spring terms. 



Objectives for Preschools, 1973-1974 . 

Schools: Hana High and Elementary School 
Lanai High & Elementary School 
Puunene School 



Revised Objective PSZ/l: 



Revised Objective PS#2: 



Ninety percent (90%) of the children participating 
in this preschool project vtIII improve (or remain 100% 
accurate) their terf^titises in each of the twelve 
categories of skitl^ on the PRESCHOOL ClffiCKLIST FOR 
BASIC SKILLS , d^ii^jped and provided by the Social 
Welfare Developm^fl^and Research Center. 

Ninety percent (90%) of the. children will improve (or 
remain 100% accurate)^ their expressive language 
functioning by participating in the preschool project 
for a minimum six consecutive months during the 1973-1974 
academic year. 
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TABLE:13. ■> ' 
' - PROJECT: \m SCHOOL 



Average Honthljr Gain on PIAT Subtests fron Title I Project and District iverage 
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HATHEHATICS MDINQ READINQ SPEIOT GiML TOTAL 



RECOGNITION COHPREHDISION INFORHATION SCORE 

' . Title I Project 

«^ - - — District Average ' . 



HAIKU SCHOOL - Reading Resource Room Project 

The Haiku School project involved 32^^J^ils from grades oni through eight 
and one reading teacher. The classroom facilities were adequate \ in space and 
furniture and a good variety of reading instruction materials werl^ evident. 
The students reported to ohe reading resource room according to grWe levels 
and l^hls ranged in number from o^e or two pupils per period to five, or six, 
depending on the nimiber selected from each §rade. ' \ 

. Th^upils of this project achieved a TOTAL SCORE average above \.l per 
month during the 1973-1974 academic year. The PIAT test results indicate that 
these children attained their lowest gains in READING (averaging ^095 gain per 
month), and the most in GENERAL INFORMATION. The MMH and SPELLING subtest 
gains were equal to the District Average. ^ \ 

WhUe the PIAT TOTAL. SCORE was .12 gain, and Just slightly less than the 
average of all projects, the variation between^,^«^test scores was considerable 
and did not follow the District' a overall achievement trends. Gains throughout 
the District more frequently occurred in the two subtests of READING, and less 
in GENERAL INFORMATION, MATHEMATICS, and SPELLING. This project's relatively 
low. gains in re^^ding may be attributed to the difficulty encountered in the 
'indiv^alization of reading instruction to eight different grad^g^ levels. With 
three',' four, or five^pupils from each grade level, precise dia^osis of pupil 
need and individualized instruction may have been less than necessary to attain 
success equal to the District average. ^ --^ 

The achievement made, however, was significant. Thede pupils were learning 
at a rate of six-tenths of a year prior, to their participation in the project, 
and twice that rate during it. The achievement rate of tl^ese pupils before the 
program began was second lowest in the District, yet their achievement rate during 
Ihteryentlon was greater than that reached by several other projects. 

1 
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. _ similarly » th6 percent of. pupils, above their previous -baselliie ratea was very, 
close- to the District average, as was the percent of these pupils who achieved 
, more than. #1 gain per month. • 

Although the pupils' BEHAVIOR Improved at a rate almost equal to the 
^ typical pupil of the District, their ATTENDANCE (as recorded and submitted) fell 
drastically in the last full month of the sehdpl year. The sudden decrease in 
attendance, as reported, was apparently due to the pupil illness. The NUMBER \ 
OF BOOKS which these pupils read, however, was reported' to have been more than 
ten times greater during the last two months of the school year than during the 
, first two. f 

The achievement of the pupils in the Haiku School Title I project was 
sigMf leant for their educational development. ^JJ^ test scores and other assess*- 
ment data, however, were xif ten inconsistent and the pattern of the gains made 
were not typical of most "reading projects. 'While the project^ was beneficial 
to the pupils and helped them decrease their nemd fOt^ remedial instruction, further 
attention during the 1974-1975 academic year should be given to «ore precise 
lndividualiz£ttion of instruction. v A^more consisten^and effective dassrodm 
management system including appropriate pupil motivation, and greater involvement 
of parents, shotild also be considered. 
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HANA HIGH & ELEMENTARY SCHOOL - Preschool Project 

The preschool project at Hana High & Elementary S(^hool Was organized and 
coordinated by the project teacher and one educational assistant. The twenty 
preschoolers utilized two rooms which were joined by an open doorway. Sufficient 
academic and achievement materials, and various other learning activities, were 
provided. The daily schedule included academic tasks, art work, play time^ 
recreation, nap and lunch times, and general socialization among the pupils. 

Each child was assigned specific duties and classroom chores for the day,^ 
such as cleaning a section of the room. Individual places on a large work . 
table were provided and individualized attention by parent volunteers was given. 
All parents of these preschool children regularly volunteered their help 
during the year. If a parent, ^assigned to help the project on a specif ic day, 
could not come, it was his/her responsibility to contact another parent^ or " 



commupity Vvolunteer to assist in the class. 

The two rooms allowed for the use of pne area as an academics-resource room, 
and the second primarily for play activity, recreation, and art work. During 
the morning period, both rooms were used for academic activity. Included within 
the roOTis of this project were two Language Masters, a tape recorder ^Ith six 
listening stations, a small library and study area, and various Instructional 
materials. Numbers and letters of the alphabet were along the walls, as was 
much art work by the pupils. One large chalk board was covered with pictures 
representing their colors, such a3 a blue balloon, a blue ball, and blue boat 
for the color blue; a brown bear f-or the color brown; a green tree for the color 
green, etc. Each set of pictures was labelled with the appropriate color of 

"BLUE", "BROWN", "GREEN", etc. 

-J ^ 
fA larger calendar checked off each passing day, an attejidance chart with 

the piSpils* names was used to encourage self '-direction (each pupil had to move 
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his/her name to one side before they were recognized ,a/^ being at school) , an4 
each pupil had their own self-made basket within which was indicated (on color- 
coded strips) the academic tasks to be completed that day. Most objects within 
the rooms were carefully labelled as "clock", "calendar", "table", "record 
player", etc. As these preschoolers earned enough points J ^•H^ppltle^fcs Letters" 
were sent home to their parents. During the afternoon hours the preschoolex^a 
had the opportunity to choose activities of their preference. / 

Table 11 indicates average improvement in expressive language skills\was 
40,2% between pre- and post- tests. This was accomplished by all twenK^Ji^OX) 
preschoolers who made highly significant improvements in the TEL scores. The >> 
norm scores showed a 23 point jump from 102 to 125 between pre- and post-tests. 
The objective (PS#2) was surpassed handily by this project. 

These twenty pupils (100%) of the Hana preschool project achieved eighty- 
four percent success on the post-test of the Preschool Checklist for Basic 
Skills. No other preschool project achieved more. The pupils made remarkable 
success on every criteria of this Checklist, although the least success occurred 
in naming and identifying the lower alphabet. One hundred percent success wa9 
attained on colors identified and shapes » with almost perfect achievement on 
color names, locomotive skills, other (social) skills, and following directions. 
Overall, the achievement was considerable and representative of the project's 
organization and environment. 

With puppets, puzzles, appropriate teaching devices, decorative and 
instructional materials around the classroom and>a specific schedule of daily 
activities, the project proved in fact, to be very successful. The two rooms 
were neat and well organized, parental involvement was fully evident, and the 
pupils aj5peared to be motivated toward the class. The Title I preschool project 
at Hana High & Elementary School was very beneficial to its pupils and highly 
effective. The program should continue to offer these academic advantages for 

oth^r preschoolers during the coming school year. 

» 
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TABLE 14 

FR(UkT:' l(AlWJ(Al OTm SCH(E 



Average Hon% Gain on ' PIAT Subtests from Title' I Pw ject and District Average 




— •: Title I Project 

- - - - District Average 



KAUNAKAKAI ELEMENTARY SCHOOL Reading Resource Room Project 



This prbject^as situated In a very attractive and adequately equipped 
classroom with sufficient reading Instructional materials. A second-year: project, 
the Kaunakakal reading program Included tjjlrty pupils, of whom only twenty-one 
were pre- and post>tested. The^aacfivr applied systematic behavioral management 
prlndlples td motivate her pupils and many showed evidences of being self -directed 
and ftinctlonlng. Unfortunately, the project teacher became 111 during the last 
two months of the school year and postrtestlng was completed by the Molokal 
Complex Child Development Team of the Special Services program. This latter 
faclsors may have influenced the relatively poor achievement outcomes of the pupils 
in this project. 

The academic gains achieved were the lowest of Maul District. No subtest 
gain was at or above the average, and none reached the .1 n^ln per month 
>iiecessary for remediation to effectively occur. The READING gains averaged 

.07Aper month, and the GENERAL INFORMATION subtest scores resulted in the only 
^ecr^ased rate of learning in the District. ^ > ~ 

^' / Another possible reason why these twenty-one pupilsXachieved less than 

- ' A. ' 

most others throughout the District was that they were acnlevlng only one-half , 
p of a ^nth's grade level gain (per month of instruction) befoi'e the project 
begai^. ' No other reading program taught pupils with such a low baseline rate, 
and jo^^rcoming this initial deficiency was apparently very difficult. That 
these pupils, who were achieving half as much as their non-Title I peers before 
the project, did achieve a rate almost equal to other pupils is commendable. 
Seventy-one percent of these pupils were achieving a greater learning rate during 
thp project than before it began. 

While the pupils' BEHAVIOR Improved somewhat during the school year as 
Judged by the project teacher, it was less than the average improvement of ^ 
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^ ' 51 
other Title I pupils. The ATTENDANCE rate showed little change during the 
school year, yet was still well above the District average at the end of the 
year. The opposite was true of the LEISURE READING performed by these pupils, 
where their reading (I.e., number of books read) Increased during the year, 
but not as rapidly as most; projects' pupils. 

The children involved in the Kaunakakai reading project made considerable 
achievement during the school year relative to their low Initial learning rate. 
They did not, however, succeed as well as other Title I or non-Title I children. 
The criterion of .1 gain per month was not met. 
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TABLE 15 
PROJECT: KIHEI SCHOOL 



Arerage Monthly Gain on PIAT Subtests from Title I Project and District Average 
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KIHEI SCHOOL Reading Resource Room Project 




, The Kihel School reading project operated out of a rather dilapidated 
building which was fbtmerly used £or art classes* However, the facilities 
were much more adequate this year ^han previously, especially In consideration 
of the school's general overcrowded situation due to the Increasing enrollment 
each yetr. The project teacher was able to effectively utilize all available 
space and the overall learning environment was significantly Improved. 
Approximately thirty pupils were served, at any one tlm^, throughout the year« 

The Klhel School's reading resource room, with twenty-four pupils, pre- 
and post- tested, achieved significantly more than any other Title I project of 
Maul District. The monthly gains were exceptionally high, and some caution 
should be exercised In Its reliability, although the correlations Indicate that 
these children all made significant gains. These pupils achieved .33 gain 
per month In READING (or over three years). While this project was successful, 
and of considerable benefit to these pupils Involved, these exceptionally high 
gains may not accurately represent the real success that was achieved by the 
pupils « 

Grade levels three through six were served by the Klhel reading project 
and their success largely contributed to the fact thait these same graded ranked 
as the four most successful In the District « 

Achieving a baseline of .07 per month before entering this project (which 

^ . ' •> 

was slightly below the average), the pupils gained .23 of a year's grade level 

r 

for each month of the project. While these pupils made considerable Achievement 
during the school year, and the project was of great benefit to them, the 
gains appeared excessively great. During the academic year the pupils were 
learning (as recorded by test scores) over three and one/half times faster than 
they had before the project. Their learning rate in reading, furthermore, was 
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almost five tines greater during the project than before It began. No other 
Title I program matched or even approximated such high gains. ' 

Similarly, the pupils all (100%) attained learning rates above their base- 
line rates, and above .1 gain per month. Yet'the improvement of BEHAVIOR,^as 
estimated by the project teacher, was the lowest in the District, and the 
ATTENDANCE rate was second lowest (and decreased considerably from the beginning 
of the school year.) 

A classroom management system based on systematic application of behavioral 

management techniques was evl4ent in this project. The pupils were taught self- 

, x.,' '• ' , • 

^''\,\ 

direction and a good arrangement 6£ the furniture and activities permitted 
efficient instruction. 

The Klhel School's Title I reading project succeeded in improving its 
pupils academic abilities. The precise extent of this achievement, however, 
as indicated by the recorded gains, should be accepted with 'caution. The 
actual success of these pupils may be more accurately assessed from their contlnu 
ed achievement during the 1974-1975 school year. 
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KILOHANA ELEMENTARY SCHQOL - Reading Resource Room and Counseling Project 

■ V 

Objectives for Reading and Counseling Project, 1973-1974 

Revised Objective. KS#1:,. - To ef fectively. 1^^ 

reading skills so thejr achieve, on aii average, a learning 
>v rate. greater than .1 average monthly . gain "In grade 

IP equivalent scores for reading recognition and reading 

comprehension between pre- and post-tests. 

ievlsed-Gb^^LQtlve KS#2: Attendance at school of Identified pupils of this project ^ 

with att^endance problems will, on an average. Increase . 
» by fifty percent (50%) from the months of October and 

December, 1973 to the Months of February and Apfll, 1974. 
Attendance of all other participating students will 
Increase by* an average of five percent (5%) . 



Revised Objective KS#3^ The personal and Interpersonal Interadtlons and behaviors 
' ' of tl^^ participating pupils In this project will, on 

• an average,* Increase by 3^% between the end of 

Septanber, 1973 and the end of April,- 1974. 

Rqylsed Objective KS/A^r The pa^lclpatlng pupils' self concept will, on «i 

average, be Improved by 25% between the pre- and poat- 
/ tests of Individually administered self concept measuring^ 

Instruments. ^ \ * . 



The ESEA Title I project at Kllohana Elementary School Involved separate 
reading and counseling components. The two components were staff e^^y a reading 
teacher and a counselor operating out of two separmtie but~Mequate^^ 
Botih components featured Individualized Instruction with a good assortment and 
array of^^adlng Instruction materials, perhaps the best of any school within 



Maul Dl^^trlct. Each component also featured a variety of media devices to be 
used with the Instructional materials. The reading teacher, to enhance Individual- 
ization and motivation, applied systematic behavioral management techniques - 
Including a token economy and a contingency contracting system. 

The pupils' achievement on aU. subtests except MATHEMATICS Indicate gains 
less than the District Averages, yet most are above the remedial criterion 
level of .1 gai^ per month. Both READING -ubtest gains were ^2 per month, or 
two/tenths of a year greater than the average non-Title I child. Such scores 

• * ' ' ' 68. 
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which were relatively consistent Bi\d typical of the District's general achieve- 
ment. Indicate that remediation In reading 'wa^ occurring. 

This project's baseline rate was .08 per month, and equal to^the average ^ 



of all other pupils' learning rates Achievement during the school year was 
also close to the -District averages » with four other project^^^^achlevlng at or 
above the .12 monthly gain In reading and three below this level. 

As a reflection of the pupils* test scores, both the percent of pupils 
above their baseline rates and above .1 monthly gain were somewhat less than the 
average District achievement. BEHAVIORAL improvement, however, w^s similar to 
that of other projects, as vas the slight diecrease in ATTENDANCE. The NUMBER 
OF BOOKS read by these pupils decreased during the year» and this was the only 
project in which this occurred. Such ^subjective data, however » may not be 
accurate, for while the books decreased in number their size and difficulty may > 
have Increased. 

The Piers-Harris Children's Self Concept Scale entitled, "The Way I Feel 
About Myself," was used as one of the Instrikients to measure objective KS//A. 
The Scale is a quickly completed self-report Instrument designed for children 
over a wide age range. The Scale Vas designed primarily for research on the 
development (5f children's self attitudes and correlates of the^e attitudes. The 
authors caution tha( any use of the Instrument, other than for research, should 
entered into cautiously and subject to specified limitations 1 
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TABLE 17 







Piers-Harris Children's Self -Concept Scale: 








Mean Scores by Grade 


Level, Kllohana School 






Grade 


- --— — — 

N 


Pr e-P er c ent i le * 


N. 


Post-Percentlle* 


GalnAiOsd 


2 






3 


74 


+5 


■3 


?. 

D 


77 


6 


79 


+Z ■ 


4 


10 


69 


10 




-0 


5 


5 


38 


5 


49 


+11 


6 


6 


52 


5 


80 


+28 


Total 


32- 


61 


30 


70 

/ 


+9 



*The norms used for converting the raV scores to percentiles are for grades 4-12. 
No norms are available below grade 4. ^ 



These scores indicate that the students at Kllohana School have a higher 



self-concept tha&. 61% (pre-I and 70% (po^tir) of the situderit ^pulation from 
grades 4 to 12. Each grade, except for the fifth grade, was above average 
(50th percentile) in self-concept. 

Analysis of individual scores indicate that 18 students gained an average 
of 19.7 in percentile rankings while 10 students lost an average of 18.2 
percentiles. Two students showed no changes. Tlie average gain is unreliable 
since a few pupils made extremely high gains while others made little gain 
(or considerable losses) from their initial percentile scores. The sixth 

lers as a group » however, made the significant average gain of 28 with a 
iligh corrielation^ Since average overall gain was less than 25%, this measure-^"^ 
V^/tnent of objective did. nc^achieve the criterion. As noted in the Piers-Harris 
^^ilanual,-a higher score, j^hquld be expected between pre- and post-tests. If this 
scale Is used t<y' evaluate any program, a comparison control group is essential. 

70 • . ■ 
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The Children's Internal-External (I-E) Scale was also administered to the 
Title I participants at Kllohana School to measure Objective KS#4. The I-E 
Scale is a short paper and pencil test with forms available for use with adults, 
high school youngsters, and elementary school youth. This scale measures what 
is called the internal-external (I-E) locus of control. It is a continuous 
dimension rather than two separate categories. 

Internal locus of control simply means that the person sees his or her ^ 
behavior as '^)eing self-determined or "coming from within". External refers 
to the opposite, i.e., detenplfried by otheyrs or "coming from without". The 
distinction is analogous to the difference between skill and luck or fate. 

The purpose of lusing the I-E Scale in the school is to investigate its 
potential to obtain maximum effectiveness of school programs. In such instances 
the names of individual students or teachers are necessary. Student and teacher 
scores, their various combinations, e.g.^^ E-E; I-I, I-E, E-I) may well 

relate to grades, attendance, achievement test scores, and t.o the type of 
programs which work best with which stude^tQ (teachers and combinations). 

TABLE 18 ^ / J 

I-E Scores By Grades; Kllohana School 

*^ . •■ » 

Grade Average Score 

K 3.8 

2 5.1 

3 2.7 

4 4.2 

5 - 4.8 

6 ) / 2.8 
Total 4.1 



7i 
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The possible range of scores is from 1 to lO. The higher the score the 
more externally orlentedJL^ the Individual. The average scores listed above 
show that grades 3 and 6 are relatively more Internally oriented and grades 1 
and 2 relatively more externally oriented. These scores may be -useful if they 
are matched with the I-E scores of teachers and correlated with grades and 
attendance. 

^^Ldult I~E Scale was administered to niAe teachers at Kilohana Sch6ol. 
The p^j^ble range of scores was from 1 to 29. The teachers^ scores were 
generally low. to low-aVerage with a score range of 2 to 12 . Based on the 
t-E combinations, if pupils with low scores (I) were matched with and taught 
by teachers with low scores (I) , such pupils would probably have made more 
significant Improvements in schoo} than those whose scores were not matched. 

Finally, a correlation study was made from the results of the Pierfl-Harris 
I-E Scale „^ and PIAT scores to determine if there were any relationships between 
the gains of the students participating in the ESEA Title I project. 

TABLE 19 
Correlati ons ; Kilohana School 

a [ ' 

Gain on Piers-Harris and Gain on PIAT = .06 
Gain on Piers-Harris and Gain on I-E =(.O60 minus . 
. Gain on PIAT and Gain on I-E « .25 



Conclusion: There wqs no reliable relationship among the gains on the Piers-Harris, 
PIAT, and*re-test results of th^ I-E Scale. 

The reading project at Kilohana Elementary School helped its Title I pupils 
to achieve more than the typical pupil, and thereby helped to close their gap 
in acadonlc ability* Some questions must be raised regarding the apparent 
duplication of effort by the reading teacher and counselor. Amalgamation of 
both components into one unit may effect even greater achievements for the 
educationally deprived pupils ofE^st Molokai. 
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KULA SCHOOL - Reading Resource Room Project . / 

The Kula School's ESEA Title I reading project involved thirty pupils 
from kindergarten through grade six. With two, three, or four pupils from 
each grade level, approximately five children would meet together each class 
period* Gains achieved during^ the year by these pupils were relatively large 
and indicate the relative success of this project* The criterion of achieving 
more than *1 per month was met on every subtest, with the READING gains 
(*175 per month) especially high* The increased academic abilities shown by 
the high scores on other subtests were largely due to the reading improvement 
of these pupils* 

The project^s pupils were among the most achieving Title 1/ children in 
the Disti^iict* While their average baseline rate before the project began 
was *07 (or just below the District average), they we^e learning at a rate 
more than twice: as fast during the school year* 

« The success of these pupils was also shown by the fact that 92% of 
them achieved above their baseline* learning rates, and eighty-three percent 
increased their achievement beyond the *1 monthly criterion level. While the 
pupils* BEHAVIOR was estimated to have improved only alightly, and their 
ATTENDANCE rate (although highest in the District) did not improve, the 
NUMBER OF BOOKS which these pupils read increased during the year* The pupils 
each read approximately twq, and one*half books during the last two months of 

the school year than during the first two, 

Despite •the continuing problem of very inadequate f acilities - the 
teachers' (men) lounge served as the reading resource room - the Kula School's 
reading program was effective, very beneficial to the pupils, and of significant 
value to the childrens* future academic success. This school will not be 
eligible for ESEA Title I programs during the 1974-1975 academic year due to 




the economic status of families of the total school popu}.atlon. 
;;;^Eveiy attempt should be made to continue some form of specialized reading 
servicesv f or the underachieving pupils at Kula. 
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LANAI HIGH AND ELEMENTARY SCHOOL - Preschool Project / 

The project teacher, educational assistant, and nineteen children of the 
Lanai preschool project were located in a large and adequate classroom area 
at the school. The pupils engaged in music, physical exercise, academic 
tasks, lunch and nap times, and considerable art work, and handicrafts. One 
section of the room was primarily reserved for academic work, while another 
was exclusively for art and enrichment activities. Sufficient equipment and 
instructional materials were provided for the pupils, the classroom had an 
adequate number bf desks and chairs, and- floor space was effectively utilized. 
Attached to most walls and chalk boards was the art work which pupils 
' had completed. Niimbers and letters of the alphabet were evident, and each 
'Ipupil was expected to perform specific academic tasks during the daily routine. 
Most significant about this preschool project was the effective control of 
the children which was demonstrated by the project teac'her. She expressed 
confidence, motivation, and entl/usiasm for the project, and this was apparfently 
felt by the pupils and became a part of their daily ^ctivities . 

As it is indicated on Table 11, average improvement in expressive language 
skills was 42.8%, highest among the three preschool projects in Maui District. 
All (100%) of the pupils showed signi^ant gains in the TEL sAres between 
pre- and post-testing. The avera^ norm score fpr the project changed signifi- 
cantly from 90 to 115. This prWct fully achieved Objective PS #2. 

The nineteen pupils of this L^nai preschool project achieved an average 
of seventy-two percent increase on their performance of all twelve criteria of 
the Preschool Checklist for Basic Skills. This was tjie highest increase of any 
preschool project in the District. ^Jhile the post-test 

achievement was consistent among all item criteria, the greater gains were made 
In naming and identifying the letters of the alphabet. Such large gains in 

- . 77 
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this area were not typical of, other Maul preschools but they do reflect the 
classroom environment, academic emphasis, and the enthusiasm of the projept 
teacher. 

The Lanal preschool project was successful. It significantly benefitted the 
preschool children Involved, and Its effect will hopefully be of lasting value 
to these pupils as they enter the early elementary grades. 4 



ERIC 



> 78 



V 



, c 

•H 

0 
> 

li 

c 
c 



TABU: 21 » : ' ' 

PRaiEQ: ,PAIA SCHOOL 
Average Hoathly Gain on PUT Silteets froa Title I Project and District Average 



•27+ 

.26 ■ 














.25 


— -iU. 








i 

f 




.23 

•22^ — — 










c 


V . 


.21 

.20 










— h 


r 


.19 

,18 







^V" — 








.17 

.16 




*r<.-/.,. ,., 






k\ ■ 


— 


.15 

.11 




r / 


_ 


■ / J. 

/ ^ 






.13 ( 

•12 




/ 






V 


^ 


1 — ■ 


.11 

.10 






k 






r 


.09- 

.08 ' 














.07 

.06 














.05- 




1 











MATmnCS MDBS BEADMl 
RECOGNITION^ COMHENSIOM 



SPEIM 



GENERAL 
INFORMATION 



TOTAL 
SCORE 



■ ^ Title I Project 
- - - District Average 



ON 
ON 



ERIC 



80 



PAIA SCHOOL - Reading Resource Room Project 

The Paia School reading project has exhibited steady growth and Improvement 
over the past few years. Conveniently located and adequately furnished with 
equipment and materials, the reading program's Improvement can probably be 
attlbuted to the stable assignment of the same teacher over the period since 
ESEA Title I programs were Implemented at the school. 

The gains achieved by the* children In this pyoj^ct were generally above 
the .1 average monthly gain criterion level, with their achievement in READING 
especially high. ^The unusually great gain in READING COMPREHENSION (.19 per 
month) indicates the direct Influence which this Title I project had upon 
these children's reading achievement. The gain obtained on other subtests may 
have been largely due to the pupils' reading Improvement. 

These children, from the first through fourth grades, achieved an average 
&^^^^0Km PIAT test which was greater than the .1 per month criterion. 
All subtests (except MATHEMATICS) were also above this level of achievement. ^ 
Their baseline rate, however, was .1 before the prograin began. Due to this 
r^lative^y high baseline achievement virtually little Increase could be expected 
in the pupils' functioning ability. The typical pupil in this project was 
achieving approximately^ as much dtirlng the reading intervention as he had done 
prior to entering the project. However, 66% of the pupils succeeded in 
Surpassing their baseline rates while 59% of the pupils achieved above the .1 
monthly gain. 

The pupils' BEHAVIOR, however, was estimated at having Improved considerably 
at a rat^ well a]bove any other project. Yet, while the project teacher judged 
their behavior as having Improved, the pupils' rate of ATTENDANCE decreased by 
almost twenty percent. Data regarding the NUMBER OF BOOKS which the ^pupils, 
read was not submitted. 

81 
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* While the Pala readlng^^source room was successful In improving the 
pupils* reading performance,- their overall gain and average score did not 
surpass the ability>level which ej^isted l^efore the program began. The averaging 
of g^ny scores and subtest gains was unusually detrimental to accurate' asse^- 
ment of this project's specific effectiveness. As a reading project^^ however, 
the gains attained in READING RECOGNITION and R^ING COMPREHENSION were high, 
arid the program was very beneficial to the children's long term success in ^ 
school. Increased follow-through activities* with the children in their regtilar 
clasisrooms may help to Improve overall^ performances of those Title I students 



at .Pala, School. 
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PtlUWENE- SCHOOL - Pfescho&l Project • ,r.'^Jf " - 

. Twenty children were involved In the Puunene prV^hhp^)! pra|Kt. TlAs ' 

Title I program was organized and mcuiaged by the jpt^-Jiect teacher , and supported 

■'^A ' . ■ -i" ■ : •. ^ . ■ , 

by one educational assistant. The pupils worked on academic ^^adks, engaged in 

' ■ ■ ' ' ■ ; . . ■, . 

physical' exercise -and art and enrichment activities, ^nd were provided with 

lunch and rest periods. Sufficient instructional' "jequipment and materials were 

provided, and adequate supplied^ of art "and handicraft materials were also 

avail^le in a classroom facility wh;lch was mqr t Han ^^^^^|fj|j^ jJ^ ^ 

One hundred percent of the preschool pupils; ^at Puune^^ 

their TEL scores during the year. This acKievanent^surpasfite^^TO^ 

criterion (PS#2) and as ' indicated pn Table expressive 



language skills JUnproved by lift' average of 26.:8^. the^^^ score averages 

" ■ '^'s ^ ■*>. > ; ViV'^. '••■■>. , ■ ; 
moved from 92 to 10^ a change of 13 ppint|i;wHlc^t; was^^^^^^ 

■ ' 7 ~ ■ W ^ ';-v,^'r'ief^' ^ 'J,:": 

The twenty pupils of th^Pqiinen^ ptfe^haol pripjecjfc Incrfearfed their 

achievement on the Preschool, ChecHligt f,oic M^ This was 



considerably lower than the sevffefi^^^ average for the District. 



The objective that 9d>8e*^o^thGse children ll^prcw^^ Checklist was not met. 

Only 83% of these preschoolers made some dtji^ on this test. 

* While ttepost-jtest r^siilt^ of the Puunehe- preschool project were lower than 
the" Other two preschools* (51% vs. 84%) , the pre-test scores were considerably 
higher (31% ^s. 15%>. The resultant differences between the pre-test scores 
and those from- the post- test were therefore relatively small. 

While the project teacher of the Puuhene preschool exhibit;^d considerable 
dedication and concern for the personal welfare and education of these children, 
the general comm^j^ty environment and the apparent lack of adequate support 
from the parents may have inhibited the achievement of these pupils toward — 
grejater success^. The preschool'project was ney^r-the-less beneficial to the 
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participating pupils. Because the school does not qualify (economic crlted|^n) 
for ESEA Title i program^urlng 1974-1975, ^he#lreschojj|j|. program will ' 
terminated at Puunene. Faced with apparent severe' cultural and social 
deprivations these children will require some form ofi^ontlnued assistance and 
preparation prior to their enrollment In regulat, school classroom. Comnninity 
action through able leadership and guidance may help restore that which the 
ESEA program can no longer continue* 
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WAIHEE SCHOOL - Reading Re0Wyce ;;»^ ■ * ' 



i.' Located In more adeqiS|^&feiait|e6 this year, the Walhee School reading 
;^roj4ct was adequately fwh^^g and equipped vd.th a good supply of reading 



liistruction materials. ^Bpl&ject teacher, in her third year in the position, 
ably structured the classroom for self-direction and effective motivational 
'managemeili through systematic positive reinforcement techniques. Thirty, pupils 
were serviced throughou^ the year and they represented the entire school - 
grades one througl? eight - except kindergarten. The gains throughout the 
year by the pupils were not as high as anticipated and this may have been ^ 
(at least In part) a result of the many different grade levels served. With 
approximately four pupils from eight different grade levels, accurate diagnosis 
and prescription of materials to each child was difficult for the one teacher 
to effectively accomplish. ^ 

The pupils did, however, attain a .11 gain pet month in READING, yet a .09 
monthly achievement rate in the other three subtests of the PIAT. That the 
gain was greatest in READ^G. reflects the real success of this project, since 
the emphasis of the project ^was directed to reading Improvement. The higher 
gains in reading are probably not due to chance, but to the effect of the 
t^jfofr^ upon these children's ability. ^ ■■j- ^ 

' ^ project helped these children to increase 'their baseline learning; rate 

by ti^ree-tenths ot a year. While learning at a .07 average monthly- rate befor^ 
entering this readi^ program, the ^h^ldrep reached the . 1 gain jp^ i;<lnth , 
during the school year. Although the.gains wfre not equal |p l?i?5)istrict 
average, they nevertheless l^epresent an dnitia] beginning from which the 
pupils may continue to develop" and increase their successful educational 
accomplishments. 

The level of success attained by these thirty pupils was also shown by 
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the fact that 77% of them 
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iTlearnlng rates above their baseline rates. 
Such academic improvement was probably rewairdlng for them, and with continued 
remedial hp^p they may be able to> successfully matfih the accomplishments 
of other, even higher achieving, non-Title I puptiS. 

The Children's BEHAVIOR was estimated to have improved at a xate equal 
to that of all other Title I pupils in the District. J* though their ATTENDANCE 
rate decreased sW^ht^^during thie school year, it was still well above the 
District average during the four months that the assessment was made. An 
increase in LEISURE READING also occurred within this project, as measured 
by the number of books read during the first and li&st two^months of the school 
year. (The actual number of books read by the pupils, however, wap consider- 
ably fewer than those read by the pupils of any other reading resclkrce roomV) 

\ ■ ■ ■ ijL.^, ' ' ■ * . 

The Waihee Tit^^ I remedial reading project was successful l|Jf that it 
Improved the average readii^^ility of its tlhirty pupils. Gains on other 



subtests were not as gxreat, but^:' the^ 
which this project had upoa^. 
i.e., with a more ^homogeneo 
been more ^^ccurate and «the 





do not reflect the more direct emphasis 



With^pupils from fewer grade levejs. 



4ividuallzed instruction could have: 



iofIs^ effective. 
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WAILUKU ELEMENTARY SCHOOL - Reading Resource Room Project 

'IT- 

The ESEA Title I reading resource room at Wailuku Elementary School 
involved 53 pupils, the^piltect teacher, and one educational assistant. The 
classroom desks and tables were conveniently arranged and the instructional 
materials were centrally located. Teacher-meide materials and commercially 
prepared reading materials allowed for individual diagnosis. and prescription 
of specific instruction for each pupil. Reading enrichment games w^e also 
available for upe by the pupils. A tapB recorder with listening posts. 
Language Master, and phonograph were a fundamental aspect of daily classroom 

. ' ' , ' ■ • . i , . 

activity. Instructional strat^giies included one-to-one, small group and 

■ l ^' . • ' ; ■ V:. ; 

independent learning activities. 

A large wall chart which graphically indicated individual^i^|pll progress 
was utilized throughout much of the k:hool year. While the purpose of the 
chart was to show individial achievement and encourage the pupils to earn 
better grades, it also recorded J:he points earned. These points could 
be spent on feames and free time activity. Ceirtificates were awarded for ?t 
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ekceptional work and primary rewards wetre used to increase pupil mojgLyation 

* ^' 

for lesser tasks. Simple reinforcing event menus "showing the work required 

jf ' ■ * ■ ^ 

for completion of group contracts, were also posted appropriately on the 

walls, as wAre objectives for. desired classroom behaviors. ^ * |- 

Seven- pup^s ^o began with the program in September either left the 
project or were absent during the post-testing peripd during the second week 
in M^y» The achievement and academic gains attal^||d by the 46 pre* and post- 
tested p^upils of this project were |^ry high. 

' With accurate diagnosis of pupil needs, sufficient Materials, individual* 
ized instruction, *and the help of an assistant, these gains were not unreason- 
ably great or out of proportiotl to the ei||l<iklveness of the projfeet^ Of 

- ■ , '. - 91 
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significant benefit to the program, and to pupil achievement, was the fact 
thittt. the systematlj^ classroom management system was established to enable 

^ these pupils to be self-directed. Upon entering the classroom they knew 
exactly where to go and what to do for the day. ' 

The READING RECOGNITION and READING COMPREHENSION gains were considerably 
above those of the other subtests, and averaged ,28 - or almost triple the 
.1 monthly criterion level. Thes^^hlldren also made significant gains on 
the other three subtests, reflecting the immediate benefit from an improved 
reading ability. All gains achieved on the PIAT test, meaawhile, were 
realtlvely similar, with only .04 average monthly difference between subtests. 
Averaging .1 monthly baseline before the project began, these pupils achieved 
a learning rate , considerably above that during intervention. Two and three- 
: t?intlj^ gained by the pupils of this project, and over half of 

. ^hat was entirely remedial. By the §nd of the year the children were one and 
three-tenths of a year cl,oser to the ability level of J^eir non-Title I 



counterparts. ?v*y- 
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No less than 98% of these pupils achieved learning rates above their 
baseline rates, as well as above .1 monthly gain. Only one chUd did not 
at^cmlcally benefit from this project with equal success. The pupils' ^ 
•EHAVIOR improvj4d (as estimated by the project teacjier) at k rate somewhat 
tjipiM than thesis trie t average, yet thp ATTENDANCE rate fell by seven percent. 



'TU. though the ISIUMBER OF BOOKS which the pupils read increased very Slightly, 
the difficulty land length of these books also appear^ to inciwaire ^fifil the 
school year. ' ' ^ ■ ^ ^ 

The reading re^urce room a't Wailuku Elementary School was a/very successr 
ful and 'eff ectflve Title I project. Academic achievement by the pupils was 

^^^^ reliable and consistent. It was t|^ only project 



In Maul District that attempted and succeeded In following nearly all 

' u • ...... 

recommendations from the 1972-1973 Evaluation of Broject Components . The 

c 

classroom was well organized, the pupils self **dlrected, and the project's 



success was commendable « V 



■ - . . ■ ; ^ • 

. A. •■ , ' >,.\ii:-:''>^-''^. ^;.■^~,'^>■f^u.^.^T•■^■ 
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Note: The, many notable accomplishments and achievements of the Maul District 
ESEA. Title I projects are summarized here, ^any areas In need of 
Improvement *were Identified and have been previously discussed with 
, the personnel of the Maul District office. A number of recommendations 
' have already beeij Implemented - at this writing - and the situations \ 
' "remedied or improved. / 



The 1973-1974 Maul District ESEij^itle I program Involved the following 
general statistics: 

ESEA Title I Schools . . . . . . .......... 11 

Number of' component projects ...... 'w .i^. ^ . . 11 

Reading Resource Rooms 8 

Pjpschools . ' ....... ^ ... 3 0 

Number 'icjf Personnel . . \. . . . . r*^. . . . . . 15 

Full-time teacher U 11 , 

Full-time counselor . 1 - 



Part-time EAs 4 ^ 

i 



. #. 

Number of target pupils .............. 315 

Reading Resource Rooms .... 256 

Preschopls • ;^ 59 

The nature and content of these component pro J eqt is varied according to 

their purpose, overall design, and specif ic objectives. Th«^ reading projects 

attempted to provide individualized instruction; the preschools supplied their 

children with the necessary educatlo^l f ig^und^ations required for future 

academic success; and the Kilbhana project^ promoted among its pupils self- 

confidence and scholastic achievement. Although different atld varied, the 

goal of all projects was to provide educationally deprived children with the 

essential Instruction -for their future success in school. 

The reading projects' use of various instructional materials, teaching 

•• . ■ V - ■-..■/Wv ' ^ 

devices, and t^^phnlques of classroom management were generally adequate. The 

arrangement of materials, classroom furniture, and the utilization of 

av^^rllaSti^^ spac^, was mos^ frequently efficient, In most reading projects 

^tiitv^ was the focus and the classroom environment 

^i^netMl^^^ Approximately 82% of Maui District's Title I pupils 
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were learnlttg more, and learning at a faster rate, than they had bei^bre the 

.»■ — - . 

1973-1974 school year. Thfe knowledge gap between Title I and non-Title I 
pupii6'J(9^5'?decreasih^ as these projects* remedial serviees helped the 



pupils to overcome their frustrations and; academic limitations. 




The reading teachers* past^'/^lqlH^ their willingness to ask questions 

and utilize innovative teaching appt^Q?£tches, ajid their desire to share ideas 
and learn from one another all contributed- to the success of Maui District's 
Title I effort. Projects during the past academic year were more organized. 




more effective, and of more help to the pupils than they were during t;hi? 
1972-1973 academic year. . 

PUPIL ELIGIBILITY , SELECTION & IDENTITY 

Of the 256 Title I pupils participating in: tfiS^iladlng resource rooms, 
72% of them. were .boys and 28%. were girls. The_^^t©vement attained by both 
groups was .16 grade level per mon£h for male^^^nr«12 for the females. 
Although the boys achieved four-tenths of a year more than the girls, the 
difference was insufficient to establish specific conclusions regarding 

either the instruction or emphasis givei;i to them. ; ^ 

y 

More significant than the gdins achieved by the two sexes was the fact 
that the p];;pjects ^ad selected considerably more boys than girls. One 
hundred more boys were participating in the Title I projects than were girls 
Their baseline learning rates, however, were identical, with .p7 Average 
mSnthiycgain for the females and the males. The most probable explanation 
ei)r the greater number of boys havi^ been selected as Title I participant^ 
was that they may have been more frequently "referred'' to the project 
teacher as ''special cases'' which needed "extra help" froin additli^nal stt^ol 
personn(<>l. Extreinie caution should be exercised into accepting pupils £or 
Title I programs on the basis of such subjective referral. 
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\ " The primary reason that more boy^^'^han girls were selected may have been that 

they were referred more often by the classroom teachers, and largely because of 

) i 

the pupils ' misbehavior in class . Pupils with behavioral problems generally tend 
to be males, while girls who are equally underachieving do not as frequently 
exhibit inappropriate behaviors. Classroom behavior, however, is' not a Title I 
criterion for selection into reading ;t>rojects. All pupils should be selected only 
^n the basis of quantitative and objective test data;> and not from the teacher's 
subjective opinion, such as **the pupil is^ too. active, has & short attentjj^n span, 
and I^n't work *lth him." 

Upon referral, potential pupils might be pre-tested - with a standar^l • 

^instrument such as the PIAT, ranked according to percentile scores; and selected \^ 
on the sole basis of their academic achievement statue within the school. All 

Schools are well represented by the excellent special education services program 
of Haul District. Problem oriented youngsters with diff iculties 4" addition to ^' 
aca(|emiQ^chievement should I6gically be referred to this program. This does 
not imply that unmotivated pupils with behavioral problems*^hould not he consider- 
ed by, the Title I progi-am. ^^h^e appropriate learning and structured, instruction 
are essential, particularly in reading. skills, refenj^ to the Title I project 
may* be the best option available for thi youngsters. 

Since referral to any/but-of-dhe ordinary instructional program can imply 
a negative stigma upon the pupils' self- image, caution sj^ould.also be exercised . 
in Identifying thecreading resource room as the "remedial reading" *class. This 
negative stigma and labeling can further be reduced if ^the project teacher can 
devote increasing amounts of time, when and where appropriate, providi'ng follow- 
through instruction witV '^e target* pupils/ in the r^^iglaT classrobn^ placement. 

^is, in addition to he the target pup*H.s maintaining ^heir identities in the 

classroom mainstream, 'will enable other npn-Title ,1 pupils to perceive the reading 



teacher as* a "special helper" to their regulai; teacher. 



RECOMMENDATION #1: Screening and selecytlon of pupilr?for the ESEA Title I 

projects 5 should bey based primarily on academic, deficiency 
^ , , an^ not solely on^4)ehavioral deviency. 

RECOMMENDATION #2: Care should be exercised in establishing negative ^ 



labels or stigm^for pupils who are referred to the _ 
reading resource ^"00108. * . 

tlECOMMENDATION #3: Folldw-lhrough instructional services should^ be carried 
^ ? into the target pupils' regular classcoom placement. 



STANDARDIZING ACHIEVEMENT. MEASURING INSTRUMENTS 

The uniform adoption ob the PIAT test instrument throughout Maul 
District during the 1973-1974 academic year is commendable. T^e objective , 



and consistent measurement of pupil achievement which this test provided 
should be continue^ throughout the coming years. Use of an objective ^and 
individually administered test among all projects, however, does not 
guarantee accurate* test adminUsttiration or equally reliable scores from all 
projects. No te^t is valid ujiless^^ is used ^properly, and no scores are 
reliable unless they are objectively and impartially recorded. Fur/her 
attention and emphasis outfit to be given the accuracy of test adnU^lRtration 



and the^ recording and^ reporting of the da^:a that arises from it. Test 
results must be an unbiased measure of each pupil's achievement. ' . 

To enable the establishment of a more refined and responsive 
Individualized instructional program, the us^ of more consistent and reliable 



diagnostic and placement instruments vdnould be" considered. No project was 
observed usi^g such systematic procedures. Many fine commercially prepared 
diagnostic and' placement ^materials are available on the current market.' The 
use of validated diagnostic and placement instruments can verify the • 
reliability of achievement test results which are questionably •-^Further, 



although diagnostic and'^pj^.cement test results do not Have^^tQ be considered 
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for program evaluation purposes, its availability and usefwlll enhance 



proper lnstru<;:tlona^ prescriptions and placement w 

Remedial Instruction, by Its very nature of the varvjlng degrees of 
achievement among the pupils being taught, requires Individualized Instruction 
In order that: precise Individualization of Ins^tructlon can be maintained,, 
there must be constant - dally and/or weekly -^assessments of each pupils' 



progress to the prescribed Instructional, program. No consistent and 

8tandardl2(ed progress checking system was noted among any of the Maul« 

- • •» 

Plstrl/ct BSEA Title 'I projects. Serious consideration should be directed 
towards the development and adoption of a uniform heir archy of instructional 



objectives for reading skills (or other appropriate academic skills) and • 
appropriate classroom behavior al^kllls. » 

Criterion referenced tests accompanying such objectives have the 
advantage of 1) permitting direct interpretation of progress in terms of 
specified behavioral objectives; 2) facilitate individualized instruction on 
a consi^tfiQ^ and sys^matic basis; 3) eliminate a)* situation wh^re half or more 
of ^Maul's scho^ children must always be below the median ; 4) |ftable teachers 
to check on student progress at regular intervals; 5) eliminate pressures 
on teachers to "teach to the test" in order to have the pupils make a good 
showing; 6) enable teachers to compile a comprehensive record of the pupils' 

■■ ' ' ^ ' - ' ' ■ ■ • ■ ■ • y 

. development and clearly identify additional instruction required. 

■ ^ • ^ ' \ 

f^ince non-academic. classroom behavioral 'object Ives are unique to each 

locale, achool and classroom, a hierarchy -of such objebtlves should be 

devell)pq^ individually by each project in concert with the general classroom 

expectations Of teachers the various schools. The availability of a 

^^e Ir archy .^f non-academic clas^s^om behavioral objectives will enable 

consistency among teachers to .help children learn behavlBFal skills * 

- ' 1 . ' 

/consistently and systematically. ' 
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RECOMMENDATION #4: Refine, testing procedures for academic achievement test, 

i.e., PIAT,, to* improve the reliability of such results. 

RECOMMENDATIpU^S : Identify and utilize valid diagnostic and > placement , 

tests to improve individualizatioh of instruction and 

help validate achievement test results. 

' J. • * ■ . . - . 

RECOMMENDATION #6: Seriously consider 'development and /or adoption of a 

hieraVchy of reading skills objectives wfth accompanying 
' ' criterion referenced tests (CRT) as an alternative 

achievemefit , diagnostic .and placement test instrument. 



. leisure' & ENRICHMEI^T READINGS 

j /Commensurate with the development of reading skills and the application 
and practice of the skills is relevant recreational and/or interest reading. 
The various reading prx>jects attempted to measure changes in non-instructional 
reading l(y recording the number of books read^ by each pupil - such coujits 
l^eing taken during the' ,iall and agstin in the spring and the results compared. 
As the results indicated^ a lack of clarity in the monitoring procedures 
resulted in unreliatlfe scores. \ - 

^ ' \ " ' - ^ 

In order that^a more efficient monitoring system can be implemented 
for leisure and enrichment reading accotoplishments by. the; Title I |^pils^ it 
is suggested that the reading teachers, in concert ^vgath their respective'' 
school librarians, develop graded lists of book titles. .The list can 
include boolls which are or are not currentltj^l^tt^ilable at the school. Among 
t^jt^'^arious criteria to.be established for the preparation of such lists 
- sliouid-be 1) the interest group geted; 2) level of difficulty - decoding 
and/or comprehension; ^nd 3) whether or not the book is accompanied by ' 
supplementary- media presentations (f ijLmstripS'^ tapes , recoriis , etc . ) . 

e task' can be more conveniently performed and less duplicated if the - 
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various participants will divide the types/levels of books by publishers, 

. ^ 99 




, and a list exchange system be Instituted and shared with all 
participants of the effort. 

RECOMMENDATION //7: Establish a graded list of book titles for Implementation 
, of a systematic leisure-enrichment reading program. 



TEACHER EFfllCTlVENESS; EXPERIENCE & TRAINING ^ J 

, Three years ago, one of the principal concerns of the Maul District 
ESEA Title I program was the relatively high turn-over in staff (project- 
teachers) from ypar to year. The lack of any stabilized pattern in teacher 
assignments (except for two or three projects) resulted in generally poor 
outcomes of academic achievement scores among the target pupils. Since the 
1971-1971 school yea^ the District's title I staff assignments'have remained 
dtable with the exception of two or three projects.' In essence, the pattern 
was reversed "and staff attrition was no longer a problem. In-service 
training opportunities were offered and the general skills and experiences /-^ 



of the personnel were upgraded. The projects began to show gradual 
Improvement and the achievement scores, on a jlistri.ct-wide basis, began 
to Improve. ^^^^^ 

Staff tu^i^-overs at the various schools are expected^^to continue, 
particularly in light of the current situation where decreasing enrollments \ 
or population shifts re4uire adjustments to the school staffing patterns. 
The mere fact that a new teacher is assigned to teach' reading in a 

• V , •• ■• 

\ , . . . ■ . / 

Title I project does not imply that the project will be less successful.. 
Neither does this mean that the assigmnent of an experienced and well;-'t;tained 
teach^ will guarantee academic successes. All new Title I reading 

teachers can be inspired and motivated towards greater experiences with - ^ 

. V . ■ : > ; 

. ' 100" , • -S'V 
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concomitant * training that will assure them i of greater successes and results 
of their efforts. Continued stability of teaching assignments will enable 
this tOjpG«H:-^--^though some changes are anticipated for the 1974-1975 
academic year. 

RECOMMENDATION //8: Teacher assignments t(|^. ESEA Title I projeclfe should be ' 

carefully screened and stabilized as much as possible. 
^ Experienced or inexperienced teachers should be afforded 

security In their assignments to enable them to make 
long-range plans regarding self-Improvements as well 
. as . Improvements to their projects. 




RECOMMEN^ION #9; Formal and informal training opportunities (Including 

classroom visitations) should be continued dnd offered 
to all experienced and new teachers Involved -In the 
ESEA Title I programs. Tralnlrjg^lans should also 
Include Inputs from the -teachers. l 



( I 
MOTIVATION & LEARNING THEORY " \ 

It was noted that most of the reading resource room projects In the 
Maul District featured - to varying degrees - some aspect of positive 
reinforcement for desirable classroom behaviors and/or academic achievement. 
This effdhft is praiseworthy and indicates the project teachers' general 
understandihg and acceptance of the significance of positive/ consequences 
to learning objectives - academic o^r non -academic. ' 

Careful observation among the various projects indicates, however, an 
undue amount of emphasis on tanglble?or object relnforcers such as edible 
treats, trinkets or toys and tokens/points continued' throughout the 
entire year. \ While it is often very necessary to begin dispeT^islng tangible 
rev^rds, to make positive relnforcers meaningful, it is ci:^clal to the 
natural development and social- growth of each learner that equal emphasis 
bfe placed on social relnforcers, such as teacher praise and |)eer recognition. 
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This can be done by pairing social reinforcement with the dispensing of 
t;anglble rewards gradually dlmlnisTilng^ the frequencjr of tangible rewards. 

' ' ' 

The Immediate dispensing of positive consequences is of ten' as equally 

xryclal as the appropriateness of the rewards. Underachieving children 

^ . • . • «^ 

exhibit lack of )notlvation merely because they are - at a given point 

- . ^ \ 

in^ time «- unable to f orsee the gratification which comes from succe; 
accomplishment. ^ ' ' 

Another ar^ of concerti to be considered isN;he proper designation of 
behavioral objectives. Care should be exercised to recognize learning 
accomplishments jcather than mere compliance or conformity to teacher 
expectations. Behaviors which are to be modeled or shaped ^aitd positively 
reinforced should be for the "goo^l^*''t>C>t^e learner rather* than fpr the 
benefit ^or convenience of the teacher. 

FinaKLy, more systematic effort should be directed towards "catching 
the child being good" rathey than "catching him being bad". BCtth 
teachers and EAs should constantly recognize and pr^ia^e children wfio 
are on-task rather than ignore such desirable traits and acttend to their ^ 
misbehaviors. 

RECOMMENDATION #10: 'Provide Immediate and meaningful positive reinforcements 

for. desirable task accomplishments. "Catch the child 
* " being good." 

RECOMMENDATION #11: Pair tangible rewards with social reinforcements and * 
' dimlnlsl) its frequaflcy. Use "natural" consequences 

increasingly and to greater advantage. 



rather than convenience to -the teacher. 



RECOMMENDATION #12: Reinf orcevbeharfiors that axe beneficial to the learner 

m convei 

"A: 
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PEER TUTORING: A TEACHING STRATEGY 



An analysis •among the result^ ^£ various successful and leaser successful 



tutoring projects elsewhisre reveal that the more effective and productive 
tutorial projects had if our common characteristics. These were a) simplicity 
In organization: tutoring In one subject area. In one pl'ace, and during a 
specific ^and consistent time of the day. was more effective; b) appropriate 
ability levels of tutor and tutee: ' the tutoi^s' -,ablllty was ndt significant^ 
more (or ^ss) than three grade level's above the tutees' for mutual -leamlngv 
to occur; c)- positive reinforcement for achievement: as tutoring was 
entirely voluntary by khe pupil., the accomplishments flourished when social 
praise, teacher recognition,"* or certificates of achievement was given; and 
d> relatively close supervision by a teacher: the pupils' meeting', sitting, 
at|d talking together did not automatically Imply that a tutorial and mutually 
helpful relationship had been established. ^ * 

through Implementation of tutorial component uncler the direction of 
reading resource personnel, the pupils will lear^ mbr^e academically. Increase 
their self-confidence, and allow extra time for the project teacher to 
. further diagnose, prescribe, and individualize pupil Instruction. When other 
non-Title I pupils are liicluded as tutors or tutees, th& negatltre stigma 
tisually associated wilh spe&laj. classrooms wllX diminish. . 

[ftECOMMENDAT^JON #13: Consider incorporation of peer-tutor activities as an 

integral function of the reading resource #DOm. 
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PRESCHDOt^ FOCUS / , / ' . ' V 
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The Maul District ESEA^Iitle P preschool projects have been Indeed 
fortunate to be st;a££ed by cchnpetent and concSrned pl;of esslonal teachers. The 



measured results of all tj^ree projects have olen significantly high, 

\ ^ 

Thefre appears to be, l\owever, some lack of clarity of the focus and 
direction of preschool curricula. The stated and Implied emphasl^ seem 
to Indicate that while some are more Inclined to be concerned with the affective 
donaln, the others have been concentrating on cognitive skills,* 

Since the children ultimately enter the same educational system. It Is 
In ^der tjiat some clarifications In goals an^ objectives be agreed upon; 
^ Faretits should be actively Involved in such discussions and the Curriculum 
Guide For Early CHlldhood Education; Ages 3-8 with Emphasis on Ages 3^5 , 
prepare^l by the DOE, should be presented as a basis by which the standards are 
established. 



The subsequent development of speciflfe' goals and objectives which are 
observable and measurable will enhance thi development of better sequence and 
content of Instruction, It is then that adequate preschool preparation can 
trully J>egln to reduce the gap between educationalljf^'Sav^nt^ged and disadvan- 
taged pupils of the schools. Consideration might alsc? bU given to th4 
incotpgratlon of t^e Preschool Basic Skills Ch^jdtLlst into a continiia o^ 
affective andv cognitive learning objectives. 3 

RECOMMENDATION #1A: Clarify^^ocus and directions of preschool Instruction, 

^^Esjtablish. goals and objectives which are observable and 
^ measurable, V ^ ' ^ 

ECOMMEljlDkTION #15: Identify and prepare a A>ntinua of preschool learning 

objectives, / 
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PARENT INVOLVEMENT 



.. Parental Involvement within the Title I projects (except the Hana Preschool 

Project) wa6 generally not significantly sufficient ta affect the program. 

outcome or increased pupil achievement. While the schools* principals, project 

teachers, and educational assistants were aware of the n6ed and ultlI^ate value 

of parental invofvepient , and strived to interest * ^em in the programs^ Tniany 

■ * 

exprressed' frustrations in their attempts to elicit the l^roader participation 
of the parents. f 

Several parent, involvement meetings were. conducted during toe^^ear by the 
Maui Distric^^.Df f ice. While these meetings were attended by concerned 
f^rents, did not - and could not - represent the nearly 30,0 parents of 

Title I children in the district. Yet the effort by the District Office, 

principals, project teachers, and some concerned parents to help more parents 

\ ■ ' . ■ ^ ' . ' 

become concerned and be^^Hf^ositive influence in their chiWren s educational 

endeavor was coramendab/e. Even with such a tremendous task, the District's 

parental meetings, planning, organization*, and^ communication with parents was 

somewhat successful. With the special help of project teachers during the 

cqming scj^ool y^ar the involvement of parents wi^ln each project should 

continue to increase. ^ 

All parents^ wapt td see ±heir children succeed in learning. Since so 

many of the Title I pupils in Maui District achieved academic succ^s^ai^^W^ 

information, if conveyed to thepi ii> a\ perso^ja^ and positive manner, 

eventually and naturall^fiS^^t^ in t)/sitive responses by them. , Positive 

feedback to parents must be frequent (weekly>. Immediate, in smail/ dosages, 

and consistent . ' The ^j^pfts of ^ approximately 300 pupils can r^Ularly be 

contacted by> the'' Title I persomiel. This is a small investmerit of time when 

it is compared to the high dividends it will pay to t^he comm^iHlty, the school, 

the fam^iy,. and most teportai^ of all, the individual pupil. 

E^V - ■ 105. ^ ..V f 



RECOMMENDATION //16: Continue to exert all efforts to elicit parental 

.involvement in their children's school, df fairs and ' 
particularly the ESEA Title r programs offered. 

■ • . ^ ■ : - . ' . - 

OUTCOMES OF PREVIOUS RECOMMENDATIONS ^ 

^ Recommendations and suggestiotis made to the Maui District 4Dff fee - 
C6mpensatory Education Section, during previous evalua£ion efforts have beien 
well received and acted upon. A number of recommendajtions presented in the 
1972-19^3 Evaluation of froject Components afltd the 1973-1974 Mid-Year Progress 
Report , in particular, have been incorporated by the schoals and/br the District 
Office. / \ . ' 

1. A systc>matlc. approach to reading iti'struction, be instituted among 
\ ' ^ ^ ■ . ■ ' 

reading projects: Although this was a broad and general recommendation 

' \ the. project teachers^ have shown e^dences that their reading 

Instruction programs are moving towards this goal. A more noticeable 
trend) should begin to emerge^during the 1974-1^75* schppl year as all* 
reading projects begin refining their instructional systems. ' 

2. Induce greater parent involvement:^ Initial steps in eliciting 
pa^en^al responses have been taken by a number of reading and preschool 
teachers. This involves the, positive reinforcement principle of- 

, ''immediate feedback*'. Teac^^e^ have begun to send home positive 
not&s to parents of children who make am^ll achievements in the 
classroom: A systematic aitcl consistent application .of this simple 
technique should. In ensuing years, become a_i?outlne function. 

■ , . ' • ••><•- 

' 3. Establish priority £or remedial programs: ^s demonstrated by the 



relocat\o^J^t^ more adequate facilities, of a number of reading and 
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preschool projects,. It appears that "compensatory education^ is truly 
recognized as an Integral part of the school program In Maui District, 
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4. Secure help t^Mi^nsoHdate the preparation of annual project proposals: 
The 1974-1975 ESEA title I project proiios0l3 were consolidated into 
two specific documents - one for the preschool projects and the other 

^ ^.for reading projects. Sufficient organizational and programmatic 

designs were incorporated to assure appropriate "fit" to the particular 
needs of the participatinjg^ySchools. , • 

\ s . . ' ■ , ^ ' ■ , . , 

5 . Standardization of test instruments and data^ collection system: In 

cooperation with the program evaluators, a standardized testing and 
data collection system was implemented. All projects - reading as ^ 
well as preschool - administered the recommended achievement tests 
to measure appropriate academic skills. Standardized reporting forms 
were utilized for reporting supplementary data„ regarding the' Title I 
projects. - ^ 

6. Staff training opportunities: Despite* the severe handicaps ^of limited 
funds, it is . Indicated that every ^fort is being devoted toward - 

• providing in-service and out-service training oppox^unities for the 
Title I personnel of Maui District ^ This*' Is highly commendable. ' . 

7. Testing accuracy and reporting of 5ata: With' the stand^tdization and 

improvements in testing and (^ata reporting procedures (see .item #5, 

» ■ ■ ■ 

above) test results have become more accurate, reliable and prompt. M 

■ ■ ; ' - " - ■ 1 

Coptinued efforts at Improvement will lead to greatei; accuracy and 
reliability of the- rfepotted data, whi^ in turn/ enhances precise 
analysis aijd evaluation,. * * ' . ""^^^^ 



« - ^ J • • - ' APPENDIXv 

.. Maul Dls^ict Tltfe I Pe rsonnel * "4 • 

-A- ■ -'v . 

HaiKu School . ' -V ' ^ , 

principal - TetsuQ Kanemlts^ ' 
Readltrg Teacher Fatirlcla tlafblua 



Hax^ Hlrglf St Elem^ S^hopl * 
PrJn^ipil - Wallace Fuji^"^- 
* Fresb^obl^Te^cher - Gwen Adams ^ 
EA ^ Vl^Vtan Kanai <«'' 

Kaunak^kai' Elein« School 
FrlncfpaJl! - Edward Kaishlwamura' 
Reading ^Teacher - Susacf Tarumoto * 

Klhel School \ - 
Principal - Tony Arakaki 
Reading Teacher - MerLs Sado 

Rllohana Elem. School # ^ 

Principal - Ronald Kula 
Reading Teaqher - Aina Weight 
Counselor - Phillip Iha 

Kula School 

Principal - Kunio Kobayashi 
Reading Teacher - Satoe Kutiioki r^^. 



^1^^%± High & Elem. School 
Principal - Howard Salcamoto 
Preschool Teacher - Amy Shiroma 
EA - Marlon Honda j 

Paia iSchool 

Principal - Osamu Kawakami 
Ileading Teacher - Sandr^ Wainu^ 

Puunene Schobl 
Principal - Masami Hironaka 
Preschool Teacher Sharon Nogami 
EA - Anna Seki 

Waihee School 

Principal- Donald Shishido 
Reading Teacher - Rena Matsunaga 

Wailiiku Elem. School 
Principal - Susumu Matol 
Reading Teacher - Martha Fukunaga 
EA - Lin Chun Wong 
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